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I.  INTRODUCTION 

A.         GOALS 

This  research  will  examine  and  analyze  the  use  of  neural  networks  as  a  forecasting 
tool.  Specifically  a  neural  network's  ability  to  predict  future  trends  of  Stock  Market 
Indices  will  be  tested.  Accuracy  will  be  compared  against  a  traditional  forecasting 
method,  multiple  linear  regression  analysis.  Finally,  the  probability  of  the  model's 
forecast  being  correct  will  be  calculated  using  conditional  probabilities.  While  only 
briefly  discussing  neural  network  theory,  this  research  will  determine  the  feasibility  and 
practicality  of  using  neural  networks  as  a  forecasting  tool  for  the  individual  investor. 

The  study  builds  upon  the  work  done  by  Edward  Gately  in  his  book  Neural 
Networks  for  Financial  Forecasting.  In  his  book,  Gately  (1996)  describes  the  general 
methodology  required  to  build,  train,  and  test  a  neural  network  using  commercially 
available  software.  In  this  research,  one  of  Gately 's  S&P500  network  models  was 
validated  using  recent  data  and  provided  a  benchmark  for  further  improvement.  Gately' s 
model  was  slightly  improved  upon,  a  new  model  was  designed,  and  both  models  were 
compared  to  a  multiple  regression  model.  Finally,  and  potentially  most  importantly  for 
the  investor,  model  accuracy  probabilities  were  generated.  This  was  done  by  combining 
historical  market  movement  probabilities  with  the  model  accuracy  probability.  This 
conditional  probability  could  prove  to  be  a  vital  tool  for  investment  decision  making. 

Until  recently,  neural  network  research,  as  a  subset  of  artificial  intelligence,  was 
limited  to  the  realm  of  universities,  research  organizations,  and  large  investment  firms. 
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The  entrance  of  the  neural  network  as  an  investment  tool  for  the  individual  investor  was 
one  of  the  many  things  brought  about  by  the  explosive  growth  personal  computers. 
Neural  network  software  is  easily  available  and  is  profusely  advertised  in  magazines  such 
as  Technical  Analysis  of  Stocks  and  Commodities.  What  isn't  advertised  as  well  is  the 
amount  of  skill  and  effort  required  when  building  an  effective  model. 

This  research  validates  the  work  of  Gately  ( 1 996)  and  describes  the  development 
of  a  neural  network  that  achieved  a  93.3  percent  probability  of  predicting  a  market  rise, 
and  an  88.07  percent  probability  of  predicting  a  market  drop  in  the  S&P500.  It  was 
concluded  that  neural  networks  do  have  the  capability  to  forecast  financial  markets  and,  if 
properly  trained,  the  individual  investor  could  benefit  from  using  this  forecasting  tool. 

1.  Background 

Neural  network  theory  grew  out  of  Artificial  Intelligence  research,  or  the  research 
in  designing  machines  with  cognitive  ability.  A  neural  network  is  a  computer  program  or 
hardwired  machine  that  is  designed  to  learn  in  a  manner  similar  to  the  human  brain. 
Haykin  (1994)  describes  neural  networks  as  an  adaptive  machine  or  more  specifically: 

A  neural  network  is  a  massively  parallel  distributed  processor  that  has  a 
natural  propensity  for  storing  experiential  knowledge  and  making  it 
available  for  use.  It  resembles  the  brain  in  two  respects:  Knowledge  is 
acquired  by  the  network  through  a  learning  process  and  interneuron 
connection  strengths  known  as  synaptic  weights  are  used  to  store  the 
knowledge. 

The  basic  building  block  of  a  brain  and  the  neural  network  is  the  neuron.  The 
basic  human  neuron  adapted  from  Beale  and  Jackson  (1990)  is  shown  below  in  Figure  1 . 


Figure  1.  Biological  Neuron 


As  described  by  Jackson  et  al.  (1990),  all  inputs  to  the  cell  body  of  the  neuron  arrive 
along  dendrites.  Dendrites  can  also  act  as  outputs  interconnecting  interneurons. 
Mathema-tically,  the  dendrite's  function  can  be  approximated  as  a  summation.  Axons,  on 
the  other  hand,  are  found  only  on  output  cells.  The  axon  has  an  electrical  potential.  If 
excited  past  a  threshold  it  will  transmit  an  electrical  signal.  Axons  terminate  at  synapses 
that  connect  it  to  the  dendrite  of  another  neuron.  When  the  electrical  input  to  a  synapse 
reaches  a  threshold,  it  will  pass  the  signal  through  to  the  dendrite  to  which  it  is  connected. 


The  human  brain  contains  approximately    10      interconnected  neurons  creating  its 


massively  parallel  computational  capability. 


The  artificial  neuron  was  developed  in  an  effort  to  model  the  human  neuron.  The 
artificial  neuron  depicted  below  in  Figure  2  was  adapted  from  Kartalopoulos  (1996)  and 
Haykin  (1994).  Inputs  enter  the  neuron  and  are  multiplied  by  their  respective  synaptic. 
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Figure  2.  Artificial  Neuron  Model 

weights.  They  are  then  summed  and  processed  by  an  activation  function.  The  activation 
function  dampens  or  bound's  the  neuron's  output,  (Kartalopolous,  1996).  Figures  3  and  4 
represent  two  common  activation  functions  which  also  happened  to  be  used  by  the 
network  tested  during  this  research.    The  first  is  the  logistic  or  sigmoid  function  f(x)  = 


l/(l+exp(-X)).  The  second  is  the  gaussian  function  f(x)  =  exp  (-X2 ). 


Figure  3.  Logistic  Activation  Function 


ilH9Mi 


Figure  4.  Gaussian  Activation  Function 


The  final  output  of  the  neuron  represents  the  output  of  the  activation  function.    Large 
numbers  of  interconnected  artificial  neurons  have  the  ability  to  learn  or  store  knowledge 


in  their  synaptic  weights.  The  learning  ability  of  an  artificial  neural  network  will  be 
discussed  later,  however  this  property  makes  it  ideal  for  trying  to  identify  signals  within  a 
noisy  data  flow.  One  example  of  such  a  data  flow  would  be  the  closing  price  of  the 
S&P500. 

2.  Objectives 

The  objective  of  this  research  was  to  examine  the  theory  of  Backpropagation 
neural  networks  and  then  develop  a  model  that  would  accurately  predict  the  future 
closing  price  of  the  S&P500  using  a  commercially  available  software  package.  Once  this 
was  accomplished,  the  probability  of  an  accurate  forecast  would  be  calculated.  Given  the 
accuracy  of  the  forecast,  the  benefits  of  the  network  to  the  investor  would  be  determined. 

3.  The  Research  Question 

The  following  research  questions  allow  the  research  to  meet  the  objectives 
proposed: 

•  What  are  the  similarities  between  the  Backpropagation  neural  network  and 
the  biological  systems  after  which  they  were  designed? 

•  What  is  the  mathematical  theory  behind  the  Backpropagation  neural 
network? 

•  Can  neural  networks  accurately  forecast  a  stock  market  index? 

•  Can  multiple  regression  analysis  accurately  forecast  a  stock  market  index? 

•  Can  neural  networks  be  used  as  a  practical  forecasting  tool  by  individual 
investors? 


4.  Scope,  Limitations  and  Assumptions 

The  potential  combinations  of  financial  market  indices  or  stocks,  and  neural 
network  type  are  virtually  limitless.  For  this  reason,  the  research  was  limited  to  one  stock 
market  index,  one  neural  network  type  and  one  statistical  forecast  tool.  This  allowed  the 
research  to  build  upon  and  validate  previous  research  and  place  boundaries  around  the 
vast  topic  of  time  series  forecasting. 

The  single  limitation  in  this  research  was  the  availability  of  data.  Gately  trained 
his  network  on  approximately  four  years  of  historical  data.  The  Goldman  Sachs 
Technology  Indicator  Index  for  Semiconductors  was  added  to  the  raw  data  set  in  1996,  so 
the  availability  of  data  was  significantly  reduced.  This  limited  the  training  and  testing  of 
the  networks  to  two  years  of  data.  However,  this  did  not  seem  to  reduce  the  effectiveness 
of  the  network. 

It  is  assumed  that  the  reader  has  little  or  no  knowledge  of  neural  networks  or 
statistical  time  series  analysis. 

5.  Literature  Review  and  Methodology 

In  his  book  Neural  Networks  for  Financial  Forecasting,  Edward  Gately  describes 
the  methodology  needed  to  develop  a  network  to  accurately  forecast  financial  markets. 
As  an  example,  he  develops  a  model  that  predicts  the  S&P500  closing  value  10  days  into 
the  future.  This  research  provides  an  independent  validation  of  Gately' s  research  and 
builds  on  it  by  comparing  the  network  output  to  a  more  traditional  statistical  tool, 
multiple  regression  analysis.  Additionally,  model  accuracy  probabilities  are  examined 
using  Bayes'  Theorem. 


The  methodology  used  while  conducting  the  research  is  as  follows: 


Conduct  a  literature  search  of  books,  magazines,  and  the  World  Wide  Web 
on  the  topic  of  neural  networks. 

Identify  the  mathematical  theory  behind  the  Backpropagation  neural 
networks. 

Identify  a  Stock  Index  to  make  forecasts  upon. 

Determine  what  to  forecast  and  the  future  point  for  the  forecast  (10  days 
into  the  future). 

Determine  the  inputs  to  the  neural  network  using  economic  theory  and 
Ward  Systems  Group  Inc.,  NeuroShell  2  Professional  Optimizer  Package. 

Assemble  the  historical  input  data  and  preprocess  it  using  Microsoft  Excel. 

Using  historical  data,  train  and  evaluate  two  different  networks  using 
Ward  Systems  Group  Inc.,  NeuroShell  2  Professional. 

If  needed,  reassess  the  network  inputs,  retrain  and  evaluate  the  networks 
using  Ward  Systems  Group  Inc.,  NeuroShell  2  Professional. 

Attempt  to  forecast  using  multiple  linear  regression  techniques. 

Statistically  compare  network  forecasts  vs.  regression  forecasts. 

Determine  the  historical  averages  of  the  item  being  forecasted  occurring 
using  Microsoft  Excel  and  data  taken  from  the  Omega  Research,  Wall 
Street  Analyst  historical  data  CD-ROM  and  Dial  Data  Downloader. 

Determine  probabilities  for  a  successful  forecast  using  Bayes'  Theorem. 


6.  Organization  of  Study 

The  remaining  portion  of  the  thesis  is  broken  up  into  the  following  chapters: 
Literature  Review  and  Theoretical  Framework,  Methodology,  Presentation  of  Data 
Collected,  Data  Analysis,  and  Conclusions  and  Recommendations.   Within  the  literature 
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review,  pertinent  literature  is  reviewed  and  the  history  and  theory  of  Backpropagation 
neural  networks  is  discussed.  The  methodology  describes  the  steps  taken  to  answer  the 
research  questions.  Presentation  of  Data  Collected  compiles  pertinent  tables  and  charts 
collected  during  the  research.  Data  analysis  follows  with  a  statistical  and  graphical 
review  of  the  information  presented.  The  thesis  closes  with  the  conclusions  and 
recommendations. 
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II.  LITERATURE  REVIEW  AND  THEORETICAL  FRAMEWORK 

A.         LITERATURE  REVIEW 

The  potential  use  of  neural  networks  as  a  tool  for  predicting  financial  markets  has 
been  marketed  at  increasing  levels  in  recent  years.  Published  research  providing  a  step 
by  step  explanation  of  input  data  identification  through  network  architecture  design  and 
finally  output  analysis  is  somewhat  sparse,  however.  Kartalopoulos  (1996),  Dhar  and 
Stein  (1996),  and  Ward  and  Sherald  (1995)  all  mention  to  varying  degree  that  neural 
networks  have  the  capability  to  forecast  financial  markets.  Smolensky,  Mozer,  and 
Rumelhart  (1996,  p.  395)  provide  Weigand's  thoughts  on  time  series  analysis  and 
prediction.  Although  extremely  technical,  it  touches  on  financial  market  prediction  and 
provides  a  good  overview  of  time  series  analysis.  He  breaks  time  series  analysis  into 
forecasting  and  modeling.  Forecasting  is  short-term  prediction  while  modeling  tries  to 
identify  features  that  accurately  predict  long  term  trends.  Wiegand  states  that  these  can 
be  quite  different  and  that  the  laws  governing  a  short-term  forecast  may  not  substantially 
relate  to  the  long-term  model  or  the  actual  characteristics  of  the  system. 

More  specifically,  Weigand  claims  that  the  "...complexity  of  a  model  useful  for 

forecasting  may  not  be  related  to  the  actual  complexity  of  the  system."    Potentially 

models  can  accurately  predict  markets  where  they  are  substantially  less  complex  than  the 

market  itself.     Lowe  (1994)  focuses  on  portfolio  optimization  and  short  term  equity 

forecasting.    Some  believe  that  efficient  market  theory  causes  predictions  based  upon 

historical  price  patterns  to  be  valueless.     However,  Lowe  (1994)  postulates  that  "A 

system  which  is  apparently  random  could  have  significant  deterministic  components 

embedded  in  its  data."    He  states  that  a  neural  network's  "...ability  to  create  nonlinear 
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approximations  to  the  underlying  generators  of  data... may  be  exploited."  Lowe  (1994) 
concludes  that  it  would  be  possible  to  develop  an  "...automated  trading  system  based 
entirely  upon  quantitative  pattern  processing  techniques  capable  of  consistently 
outperforming  professional  traders." 

Lederman  and  Klein  (1995,  p.  65)  provide  Jurik's  thoughts  on  trading  system 
development.  Although  Jurik  does  not  provide  specific  examples  of  trading  systems,  he 
provides  a  wealth  of  advice  on  data  preprocessing  techniques.  He  states,  "Strive  for 
simple  models  having  only  a  few  choice  input  variables."  He  supports  this  by  explaining 
that  as  the  number  of  model  inputs  increase,  the  degrees  of  freedom  of  the  governing 
equation  also  increases.  While  equations  with  high  degrees  of  freedom  have  the 
capability  to  model  the  training  data  effectively,  they  fail  miserably  when  given  test  data. 
This  is  because  models  with  fewer  degrees  of  freedom  do  not  try  to  trace  the  data's 
random  scattering  but  only  follow  the  general  trend.  Jurik  also  states  that  "When  trying 
to  remove  unimportant  variables,  sensitivity  analysis  of  nonstationary  or  nonlinear 
models  has  dubious  practical  value."  This  is  extremely  important  because  this  is  one  of 
the  standard  techniques  used  in  regression  analysis.  If  applied  to  a  neural  network  model 
it  could  seriously  fail.  Jurik  states  there  are  only  two  ways  to  correctly  remove 
unimportant  variables.  The  first  is  to  use  a  genetic  algorithm  to  develop  multiple 
combinations  of  input  variables  while  only  letting  the  most  accurate  survive.  The  second 
is  a  manual  method  of  systematically  removing  one  variable  at  a  time  and  recording 
network  accuracy.  This  technique  is  repeated  until  the  accuracy  of  the  model  starts 
decreasing. 
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While  all  these  authors  hint  at  the  capability  of  neural  networks  in  forecasting 
financial  markets,  the  researcher  found  only  one  text  that  meticulously  tracks  the 
development  of  the  neural  network  from  data  gathering  and  preprocessing  to  training  and 
application  of  the  net.  This  text  is  Edward  Gately's  Neural  Networks  for  Financial 
Forecasting.  This  research  uses  Gately's  (1996)  techniques  for  developing  a  model  to 
predict  the  closing  price  of  the  S&P500.  His  model  is  slightly  improved  upon  and 
compared  to  more  standard  regression  methods  for  forecasting.  Additionally  and 
potentially  most  importantly  for  the  investor,  model  accuracy  probabilities  were 
generated.  This  was  done  by  combining  historical  market  movement  probabilities  with 
the  model  accuracy  probability.  This  conditional  probability  could  prove  to  be  a  vital 
tool  for  investment  decision  making. 

B.         THEORETICAL  FRAMEWORK 

As  described  previously,  a  neural  network  is  a  computer  program  or  hardwired 
machine  that  is  designed  to  learn  in  a  manner  similar  to  the  human  brain.  Additionally, 
Figure  2  showed  how  an  artificial  neuron  processes  input  data  into  an  output  signal. 
However,  the  most  important  feature  of  a  neural  network  has  not  been  explained:  how  a 
neural  network  learns.  This  research  focuses  on  the  Backpropagation  algorithm  learning 
method.  The  following  derivation  is  taken  from  the  explanation  provided  by  Dhar  and 
Stein  (1996).  All  mathematical  formulae  refer  to  Figure  5  below.  This  figure  depicts  a 
single  artificial  neuron,  which  learns  using  the  Backpropagation  learning  algorithm. 
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Figure  5.  Artificial  Neuron  Using  Backpropagation  Learning 

The  Backpropagation  algorithm  seeks  to  minimize  the  error  term  between  the 
output  of  the  neural  net  and  the  actual  desired  output  value.  The  error  term  is  calculated 
by  comparing  the  net  output  to  the  desired  output  and  is  then  fed  back  through  the 
network  causing  the  synaptic  weights  to  be  changed  in  an  effort  to  minimize  error.  The 
process  is  repeated  until  the  error  reaches  a  minimum  value.  The  network  uses  Equation 

1  to  update  the  weight  Wtj  from  a  given  node  Ni  to  the  current  node  N j ;  where  t  refers  to 

the  number  of  times  the  network  has  been  updated  and  A.  refers  to  the  learning 
parameter.  The  learning  parameter,  or  learning  rate,  controls  the  rate  the  weight  is 
changed  as  learning  takes  place.  The  sensitivity  of  node  Nj  to  a  change  in  weight  Wtj  is 

represented  by  sWtJ  and  will  be  defined  more  fully  below. 


^,<,+1)=^v+(4^X^) 


(1) 
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The  total  input  to  a  node  is  described  in  Equation  2  as: 

Sj  =  ZNiWu  (2) 

where  Sj  is  the  sum  of  all  inputs  to  a  node,  N,  is  the  output  of  the  previous  node,  and 
Wjj  is  the  weight  connection  between  the  ith  node  of  the  previous  layer. 

This  output  is  then  transformed  using  the  logistic  activation  function  described  in 
chapter  I  and  represented  by  Equation  3.  The  total  output  of  node  j  is  represented  by  Nj . 


+  e 


NJ=T^sf  (3) 


The  overall  error  for  a  single  pass  of  the  neural  network  is  represented  by 
Equation  4,  where  D-  is  the  desired  output  of  the  output  node  j. 

E-l-Zfa-DjJ  (4) 

■^  Output 

Now  that  the  error  term  for  the  entire  network  has  been  calculated,  this 
information  is  fed  back  through  the  network  to  reduce  error.  The  simplified  partial 
differential  equations  required  to  change  the  connection  weights  are  provided  below;  the 
original  equation  before  simplification  can  be  found  in  Figure  5. 

First,  the  error  term  for  each  output  node  0}  must  be  calculated.  Essentially  we 
are  trying  to  identify  how  much  the  error  term  changes  with  respect  to  a  change  in  each 
output  node.  This  calculation  is  simplified  in  Equation  5  below: 

Dj-fa-Dj)  (5) 
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Second,  the  amount  the  error  term  changes  as  the  input  is  varied  to  a  given  output 
node  must  be  calculated.  This  is  done  by  determining  how  much  Equation  4  changes 
when  the  total  input  to  the  node  (Equation  2)  is  changed.  This  calculation  is  simplified  in 
Equation  6  below: 

sSj-sOjNjk-Nj)  (6) 

Next,  the  weight  adjustment  needed  for  Wtj  is  calculated  from  a  layer  below  the 

current  layer  (  Nf )  to  the  current  node  N ' . .    The  calculation  is  simplified  in  Equation  7 
below: 

sWij  =  eSjN,  (7) 

Finally  this  operation  is  continued  on  nodes  in  lower  layers  by  allowing  nodes  in 
the  lower  hidden  layers  to  play  the  role  of  the  output  node.  All  errors  from  all  inputs  to 
the  hidden  layer  must  be  summed.  Additionally,  the  error  in  the  hidden  node  is 
calculated  by  examining  how  the  error  of  nodes  above  the  hidden  node  change  with 
respect  to  changes  in  the  hidden  node.  The  simplified  equation  for  calculating  the  weight 
update  is  provided  in  Equation  8  below,  where  the  subscript  j  represents  nodes  in  the 
layer  above  the  hidden  layer. 

j 

Dhar  et  al  (1996)  states,  "In  this  manner  the  error  of  the  network  is  propagated 
backward  recursively  through  the  entire  network  and  all  of  the  weights  are  adjusted  so  as 
to  minimize  the  overall  network  error." 
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III.  METHODOLOGY 

This  section  discusses  the  techniques  used  to  develop  the  neural  network  and 
multiple  regression  financial  forecasting  models.  The  combination  of  these  models,  with 
historical  and  conditional  probabilities,  will  allow  the  investor  to  make  decisions  based 
on  probabilities  of  success.  The  presentation  first  discusses  the  development  of  the 
models,  followed  by  the  historical  probability  calculations  and  concludes  with  the 
conditional  probability  calculation. 

The  information  to  be  forecast  was  first  identified.  Since  this  research  extended 
and  verified  Gately's  (1996)  work  with  neural  networks,  a  similar  model  output  was 
chosen  for  at  least  one  model  for  comparison  purposes.  Two  separate  model  outputs 
were  chosen,  the  first  was  the  S&P  500  closing  value  ten  days  into  the  future — the  output 
chosen  by  Gately,  and  the  second  was  the  future  S&P500  ten  day  percent  change.  As 
described  by  Gately,  a  much  more  accurate  forecast  is  possible  when  predicting  the 
percent  change  versus  the  actual  closing  value  of  a  stock  or  index.  For  example,  if  the 
S&P500  index  was  valued  at  1400  dollars  and  a  model  that  predicted  the  closing  value 
had  a  ten-percent  error  the  potential  output  inaccuracy  would  be  140  dollars.  If  the  same 
index  had  made  a  ten-percent  price  change  and  the  model  that  predicted  the  percent 
change  of  price  had  a  ten-percent  error,  the  potential  output  inaccuracy  would  be  one- 
percent.  For  a  ten-percent  price  change,  from  1272  dollars  to  1400  dollars,  this 
inaccuracy  would  translate  into  approximately  a  twelve  dollar  error. 
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The  first  neural  network  model,  named  Close  Network,  was  chosen  to  be  a 
verification  of  Gately's  (1996)  work  and  predicted  the  S&P500  index  ten  days  into  the 
future.  The  inputs  to  the  model  where  developed  by  first  downloading  the  following  raw 
data  from  Dial  Data  using  Data  Downloader  software  from  Omega  Research: 

S&P  500  Index  *SPX 

Dow  Jones  Transportation  Index  *DWT  X 

Dow  Jones  Industrial  Index  *DWI  X 

Dow  Jones  Utilities  Index  *DWU 

Commodities  Research  Bureau  *CRB 

AMEX  Oil  Index  *XOI 

Gold  and  Silver  Mining  Index  *XAU 

The  data  set  encompassed  the  trading  days  from  March  1,  1991  to  August  18,  1998. 

The  data  was  charted  using  stock  charting  software  called  Wall  Street  Analyst 
Deluxe  from  Omega  research.  This  established  date  integrity  within  each  index.  The 
indices  were  then  exported  and  saved  as  a  text  file  from  Wall  Street  Analyst.  Using 
Microsoft  Excel,  each  index  text  file  was  combined  into  one  spreadsheet.  The  resulting 
file  was  formatted  such  that  each  index  and  its  date  was  in  a  separate  column  with  each 
row  representing  a  trading  day.  An  example  of  a  partial  data  set  can  be  found  in 
Appendix  B.  Date  integrity  is  extremely  important  to  the  neural  network.  To  ensure 
integrity  was  maintained,  each  index's  date  column  was  checked  for  integrity  against  the 
S&P500  date  using  a  simple  "if  then"  rule  in  Excel.   If  the  dates  were  equal,  it  placed  a 
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zero  in  a  row.  If  the  dates  were  not  equal,  Excel  placed  a  1  in  a  row.  This  function  was 
copied  down  the  entire  data  set  and  then  summed  at  the  bottom.  A  sum  of  zero 
represented  no  date  integrity  discrepancies.  A  sum  of  anything  greater  than  zero 
indicated  that  a  date  discrepancy  existed.  The  sum  was  zero  for  all  indexes  with  the 
exception  of  *CRB.  Within  *CRB  it  was  found  that  one  trading  day  was  missing. 
Instead  of  deleting  the  index,  the  trading  day  was  added.  The  average  closing  value  of 
the  day  proceeding  and  following  the  missing  day  was  chosen  to  represent  the  missing 
day. 

The  last  column  in  the  spreadsheet  was  titled  "Future  (10  day)  S&P500  C."  This 
represents  the  future  closing  price  of  the  S&P500  Index  and  was  the  actual  value  the 
network  used  to  compare  against  its  prediction  during  training.  This  "future"  information 
was  created  by  simply  copying  the  S&P  500  closing  price  into  the  last  column  of  the 
spreadsheet  deleting  the  first  10  days  of  data  and  moving  the  remaining  data  up  10  rows. 
Once  this  was  complete,  all  date  columns  were  deleted  with  the  exception  of  the  one 
associated  with  the  S&P  500  data.  The  file  was  saved  as  an  Excel  4  worksheet  so  it  could 
be  imported  into  Neuroshell  2  Professional.  The  following  data  was  imported  into  the 
neural  network  software  package  as  a  pattern  file: 

Date 

S&P500  H 
S&P500  L 
S&P500  C 
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Dow  Transportation  Index  C 
Dow  Utilities  Index  C 
Amex  Oil  Index  C 
CRB  CDow  Industrial  Index  V 
Gold  and  Silver  Mining  C 
Future  (10  days)  S&P500  C 

The  pattern  file  was  then  altered  using  the  software's  Market  Indicator  module  to 
include  all  the  inputs  described  by  Gately  (1996).  The  following  technical  indicators 
were  added: 

MvAvg  (30)  of  Dow  Industrial  Index  V 

Lag  (10)  of  CRB  C 

Lag  (10)  of  Amex  Oil  Index  C 

Lag  (10)  of  Dow  Transportation  Index  C 

These  technical  indicators  represent  a  thirty-day  moving  average  of  the  Dow  Industrial 
Index  Volume  and  a  ten-day  lag  of  various  other  raw  data. 

Within  the  Define  Inputs  module  of  the  Neuroshell2,  each  column  of  the  data  file 
was  identified  either  as  Unused,  Input,  or  Actual  Output.  The  date  and  raw  volume 
information  was  excluded  by  defining  it  as  Unused.  The  Future  (10  days)  S&P500  Close 
was  defined  as  the  Actual  Output  and  all  others  were  defined  as  inputs.  The  minimum 
and  maximum  values  for  each  data  column  were  then  automatically  calculated  for  use  by 
the  network.  Next  a  test  set  or  "out  of  sample"  data  set  was  extracted  from  the  data  set. 
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Every  tenth  data  set  was  chosen  to  represent  the  test  data.  There  were  1 700  training  rows 
and  188  test  rows.  In  the  Designing  the  Network  module,  the  software  recommended 
using  a  Ward  Network.  The  Ward  Network  is  a  backpropagation  network  with  one  input 
layer,  three  hidden  layers  and  one  output  layer.  Each  layer  is  called  a  slab.  Each  slab  is 
made  up  of  one  to  sixteen  individual  neurons  depending  on  the  location  within  the 
network.  Each  slab  also  has  a  different  activation  function  as  described  below: 

Slab  1  (input):  Linear  [-1,1],  13  Neurons 
Slab  2  (hidden):  Gaussian,  16  Neurons 
Slab  3  (hidden):  tanh,  16  Neurons 
Slab  4  (hidden):  Gaussian  comp.,  16  Neurons 
Slab  5  (output):  logistic,  1  Neuron 

The  learning  rate  was  set  to  .05  and  the  momentum  was  set  to  .5.  Within  the 
Training  Criteria  module,  pattern  selection  was  set  to  random,  calibration  interval  was  set 
to  every  200  patterns  and  stopping  criteria  was  set  to  stop  training  at  40,000  events  since 
min  average  error  within  the  test  set.  Within  the  training  module,  the  network  was  set  to 
automatically  save  the  weights  for  the  best  test  set.  The  network  was  then  trained  within 
the  Training  module.  The  trained  network  was  then  applied  to  the  188  sample  test 
patterns. 

The  network  output  is  a  file  that  contained  three  columns:  Actual  (1),  Network 
(1)  and  Act  (l)-Net  (1)  representing  the  actual  S&P500  closing  value,  the  network 
prediction  and  the  network  error.    This  file  was  opened  and  actual  vs.  predicted  charts 
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were  created  within  Excel.  Additionally,  the  descriptive  statistics  for  the  network  error 
were  calculated.  The  Close  Network  was  able  to  make  predictions  with  accuracy 
comparable  to  Gately's  (1996)  model. 

The  second  network  model,  called  Percent  Network,  was  designed  to  predict  the 
future  S&P500  ten  day  percent  change  taking  advantage  of  the  possible  reduction  in 
prediction  error.  The  network  was  provided  the  same  raw  data  as  the  Close  Network. 
However,  two  new  columns  were  created  in  the  raw  data  file.  The  first  column  was 
defined  as  the  ten-day  %  change  in  the  S&P500  Closing  price.  Starting  on  the  10th  day, 
this  was  calculated  using  the  following  formula  (cell  1-cell  1 1  )/cell  1*100.  The  second 
column  was  defined  as  the  future  ten-day  %  change.  Essentially,  the  ten-day  %  change 
column  was  copied  into  the  new  column  and  the  values  were  shifted  back  ten  days.  The 
future  ten-day  percent  change  was  the  actual  desired  output  of  the  net  and  was  used 
during  training  to  calculate  error. 

The  file  was  imported  into  Neuroshell2  and  preprocessed.  During  preprocessing, 
the  following  technical  indicators  were  added  to  the  data  file: 

MvAvg  (30)  of  Dow  Industrial  Index  V 

Lag(10)ofCRBC 

Lag  (10)  of  Amex  Oil  Index  C 

Lag  (10)  of  Dow  Transportation  Index  C 

LinRegChange  (10,5)  of  S&P500  C 

LinRegChange  (10,10)  of  S&P500  C 
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The  technical  indicator  LinRegChange  (x,n),  as  described  in  Neuroshell2 
Professional,  represents  "Predicted  change  between  current  value  and  the  value  time 
periods  into  the  future.  Prediction  is  based  upon  the  linear  regression  line  calculated  from 
the  last  n  time  periods."  The  test  set  extraction,  network  design  and  training  settings  were 
identical  to  the  Close  Network.  Essentially,  the  Percent  Network  would  look  at  the  same 
raw  data,  with  added  indicators,  as  the  Close  Network  but  would  predict  a  percent  change 
versus  a  closing  price.  The  same  out  of  sample  data  was  used.  When  the  Percent 
Network  (1)  was  applied  to  the  out  of  sample  data,  it  performed  relatively  poorly  when 
compared  to  the  Close  Network. 

To  increase  the  accuracy  of  the  Percent  Network,  the  net  inputs  were  changed. 
The  LinRegChange  (10,5)  of  S&P500  C  was  removed  and  LinRegPredict  (10,10)  of  S&P 
500  10  day  %  Change  was  added.  The  technical  indicator  LinRegPredict  (x,n),  as 
described  in  Neuroshell2  Professional,  represents  the  "Predicted  value  x  time  periods  into 
the  future.  Prediction  is  based  upon  the  linear  regression  line  calculated  from  the  last  n 
time  periods."  After  training  and  application  to  the  out  of  sample  data,  Percent  Network 
(2)  showed  only  slight  improvement  in  prediction  accuracy. 

The  network  inputs  were  again  adjusted  to  try  and  increase  accuracy.  The 
technical  indicator  LinRegChange  (10,10)  of  S&P500  C  was  removed  as  an  input.  After 
training  and  application  to  the  out  of  sample  data,  the  Percent  Network  (3)  accuracy 
decreased. 
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At  this  point,  the  decision  was  made  to  augment  the  moving  average  of  the 
volume  with  the  raw  volume  data  in  the  network.  The  Percent  Network  (5)  performed 
only  slightly  better  after  including  raw  volume. 

A  close  review  of  the  raw  data  used  in  Gately's  model  and  the  Close  Network 
showed  little  if  any  input  from  the  technology  sector.  A  technology  component  was 
added  to  the  net  to  improve  accuracy.  This  net  was  called  Percent  Network  (5)  and  was 
based  on  the  most  accurate  network  up  to  that  point,  Percent  Network  (2).  It  included  an 
added  indicator,  the  closing  value  of  GSM  the  Goldman  Sachs  Technology  Indicator 
Index  for  Semiconductors.  Unfortunately,  GSM  has  only  been  in  existence  since  1996, 
so  the  data  set  was  significantly  reduced.  The  full  raw  data  set  begins  on  July  18,  1996 
and  ends  August  12,  1998.  Due  to  the  reduced  amount  of  available  data,  every  5th  data 
set  was  chosen  to  represent  the  test  or  out  of  sample  data.  There  were  419  training  rows 
and  104  test  rows.  Percent  Network  (5)  was  trained  and  applied  to  the  out  of  sample  data. 
The  network  showed  significant  improvement,  although  the  r2  value  was  still  not  as  high 
as  the  Close  Network. 

In  Percent  Network  (6),  the  ten-day  lag  of  GSM  C  was  added  as  an  input  to 
improve  prediction  capability.  The  network  was  trained  and  applied  to  the  out  of  sample 
data  set.  Although  its  r2  value  was  slightly  lower  than  Percent  Network  (5),  it  was 
chosen  as  the  final  Percent  Network  because  it  had  a  lower  percent  error  over  30%  and 
there  were  predictions  within  5%. 
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The  addition  of  the  new  GSM  C  data  to  the  Percent  Network  had  significantly 
improved  its  accuracy,  and  could  do  the  same  for  the  Close  Network.  Also  the  networks 
were  using  data  from  significantly  different  time  periods,  making  comparison  between 
the  two  questionable.  Therefore,  the  GSM  C  and  Lag  of  GSM  C  was  added  to  the  Close 
Network  causing  the  data  window  to  match  the  Percent  Network.  All  data  prior  to  July 
18,  1996  was  discarded.  In  the  Extraction  Module,  every  5th  data  set  was  chosen  to 
represent  the  test  or  out  of  sample  data.  Both  models  were  now  training  on  identical  raw 
data.  After  training,  the  network  was  applied  to  the  out  of  sample  data.  The  results 
showed  a  slight  decrease  in  r2  value  but  fully  100  percent  of  the  predictions  were  within 
five  percent  of  the  actual  closing  value.  This  network  was  chosen  to  be  the  final  Close 
Network  model. 

The  actual  and  predicted  values  from  both  the  Close  and  Percent  networks  were 
placed  into  one  spreadsheet.  The  predicted  closing  value  of  the  S&P500  index  was 
calculated  using  the  predicted  %  change  provided  by  the  Percent  Network.  This  allowed 
comparison  of  a  single  type  of  data  between  both  networks.  The  two  predicted  closing 
values  where  compared  graphically  and  statistically.  This  completed  the  neural  network 
portion  of  the  research. 

A  more  traditional  statistical  forecasting  tool  is  regression  analysis.  This  method 
uses  the  sum  of  the  least  squared  errors  to  fit  a  curve  to  a  data  set.  The  decision  was 
made  to  try  and  predict  the  S&P500  closing  value  using  the  same  data  used  in  the  Close 
Network.    The  dependant  variable  was  designated  as  the  Future  (10  days)  S&P500  C 
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column.  The  following  columns  were  listed  as  independent  variables:  S&P500  H, 
S&P500  L,  S&P500  C,  Dow  Transportation  Index  C,  Dow  Utilities  Index  C,  Amex  Oil 
Index  C,  CRB  C,  Gold  and  Silver  Mining  C,  GSM  C,  MvAvg(30)  of  Dow  Industrial 
Index  V,  Lag(lO)  of  CRB  C,  Lag(lO)  of  Amex  Oil  Index  C,  Lag(lO)  of  Dow 
Transportation  Index  C,  and  Lag(lO)  of  GSM  C.  Using  the  data  analysis  tool  within 
Excel,  a  multiple  linear  regression  analysis  was  performed  on  the  data  set. 

When  conducting  multiple  linear  regression  analysis,  the  following  assumptions 
must  hold  for  the  model  to  be  correct:  1.  Normality  2.  Homoscedasticity  3. 
Independence  of  Errors  and  4.  Linearity.  Normality  assumes  the  value  of  the  Y  (the 
dependant  variable)  must  be  normally  distributed  for  each  value  of  X  (the  independent 
variable).  According  to  Levine,  Berenson,  and  Stephan  (1997),  regression  analysis  is 
fairly  robust  against  departures  from  the  normality  assumption.  One  method  of  verifying 
the  normality  assumption  is  to  construct  and  examine  a  Normal  Probability  Plot  for  the 
dependant  variable.  The  Normal  Probability  Plot  was  created  in  Excel  using  the 
regression  analysis  tool.  The  points  on  the  plot  seemed  to  deviate  from  a  straight  line  in  a 
random  manner.  This  indicates  normality.  If  the  line  had  risen  more  steeply  at  first  and 
then  increased  at  a  decreasing  rate  it  would  have  indicated  a  left  skewed  data  set.  The 
opposite  is  true  for  a  right  skewed  data  set. 

Homoscedasticity  assumes  variation  or  error  around  the  regression  line  should  be 
similar  for  low  and  high  values  of  the  independent  variable.  This  can  be  verified  by 
examining  the  residual  plots  for  each  independent  variable.   For  each  variable,  there  did 
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not  seem  to  be  major  differences  in  the  variability  of  the  residual  for  different  values  of 
the  independent  variable.  Therefore,  the  Homoscedasticity  assumption  was  valid. 

Autocorrelation,  or  the  likelihood  that  a  certain  type  of  error  precedes  or  follows 
another  type  of  error,  violates  the  independence  of  errors  assumption.  If  errors  are 
correlated,  there  will  be  a  pattern  of  positive  errors  following  positive  errors  and  negative 
errors  following  negative  errors.  The  simplest  way  to  rule  out  Autocorrelation  is  to  plot 
the  residuals  over  time.  The  residual  vs.  time  plot  showed  no  pattern  and  indicated  the 
absence  of  Autocorrelation.  Therefore,  the  Independence  of  Errors  assumption  seemed 
valid. 

The  regression  line  fit  plots  indicated  a  probable  linear  relationship  of  varying 
degrees  between  the  dependant  variable  and  each  of  the  independent  variables.  This  was 
verified  because  there  was  no  pattern  in  the  residual  plots  for  each  independent  variable. 
Therefore,  the  linearity  assumption  seemed  valid. 

All  four  assumptions  of  regression  analysis  were  verified  so  a  linear  regression 
model  seemed  appropriate.  When  using  Multiple  Regression,  the  objective  is  to  utilize 
only  those  variables  that  have  a  significant  relationship  with  the  dependant  variable.  The 
first  step  in  determining  a  significant  relationship  between  the  dependant  and  independent 
variable  was  to  conduct  an  F  test.  The  F  test  was  used  to  determine  if  there  was  a 
significant  relationship  between  the  dependant  variable  and  the  chosen  independent 
variables.  The  null  hypothesis  was  that  there  was  no  linear  relationship  between  the 
dependent  variable  and  indeptendent  variables;  the  alternative  hypothesis  was  that  at  least 
one  regression  coefficient  was  not  equal  to  zero.    The  null  hypothesis  is  rejected  at  a 
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certain  level  of  significance  if  the  estimated  value  F  is  greater  than  the  critical  value  of  F. 
Excel's  ANOVA  calculation  provided  the  value  for  F;  it  was  1416.  For  a  95% 
confidence  interval,  the  value  of  the  critical  F  was  obtained  from  Levin  et  al's  (1997) 
Critical  Values  of  F  table.  The  critical  value  for  F(14,469)  is  approximately  1.67. 
Therefore,  F  was  greater  than  the  critical  value  of  F  and  the  conclusion  can  be  made  that 
at  least  one  of  the  independent  variables  was  related  to  the  dependant  variable. 

The  next  step  was  to  test  individual  portions  of  the  multiple  regression  model.  If 
individual  variables  have  no  significant  effect  on  the  model,  they  should  be  removed  and 
a  new  regression  calculated.  The  t  test  was  used,  to  determine  if  an  individual  indepen- 
dent variable  had  a  significant  effect  on  the  dependant  variable,  taking  into  account  the 
other  independent  variables.  The  null  hypothesis  was  that  there  was  no  relationship 
between  the  independent  and  dependant  variable;  the  alternative  hypothesis  was  that  there 
was  a  relationship.  The  decision  rule  was  to  reject  the  null  hypothesis  if  the  estimated  t 
was  less  than  negative  t  critical  or  greater  than  t  critical.  For  a  95%  confidence  interval, 
the  critical  value  for  t  was  obtained  from  Levin  et  al's  (1997)  Critical  t  Table.  The 
critical  values  for  t  (.025,14)  were  -2.1448  and  2.1448.  Eight  of  the  14  independent 
variables  failed  the  t  test  and  did  not  have  a  significant  relationship  to  the  dependant 
variable.  The  regression  was  recalculated  using  only  those  independent  variables  that 
passed  the  t  test. 

At  this  point,  all  assumptions  were  reevaluated  and  found  to  still  be  valid.  The  F 
test  was  then  repeated  on  the  second  regression  model.  The  critical  value  of  F(6,477)  is 
approximately  2.1.     The  model  passed  the  F  test.     Therefore,  at  least  one  of  the 
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explanatory  variables  was  related  to  the  dependant  variable.  The  t  test  was  then  repeated 
on  the  second  regression  model.  The  critical  value  of  t(.025,6)  is  2.4469.  In  reviewing 
the  t  values,  it  was  determined  that  there  is  a  significant  relationship  between  the 
dependant  variable  and  all  independent  variables  with  the  exception  of  Gold  and  Silver 
Mining  C.  This  input  was  dropped  and  a  third  regression  was  calculated. 

Again  all  regression  assumptions  were  reevaluated  and  found  to  be  valid.  The  F 
test  was  then  repeated  on  the  third  regression  model.  The  critical  value  of  F  (5,477)  is 
approximately  2.21.  The  model  passed  the  F  test.  Therefore,  at  least  one  of  the 
explanatory  variables  is  related  to  the  dependant  variable.  The  t  test  was  then  repeated  on 
the  second  regression  model.  The  critical  value  oft  (.025,6)  is  2.5706.  In  reviewing  the  t 
values,  there  was  a  significant  relationship  between  the  dependent  variable  and  all 
independent  variables. 

The  final  test  of  the  validity  of  the  multiple  regression  model  is  to  verify  there  is 
no  multicollinearity  between  the  independent  variables.  According  to  Levine  et  al 
(1997),  when  two  independent  variables  are  highly  collinear  they  can  cause  the  regression 
coefficients  to  fluctuate  drastically  if  one  or  both  are  included  in  the  model.  It  is  difficult 
to  separate  the  effect  of  to  two  collinear  independent  variables  on  the  dependant  variable. 
The  measure  of  collinearity  is  the  Variance  Inflationary  Factor  (VIF).  For  each  of  the 
independent  variables,  the  VIF  was  calculated  using  excel.  If  sets  of  variables  are 
uncorrelated,  the  VIF  will  equal  1.  For  highly  intercorrelated  variables,  the  VIF  can 
exceed  10.  According  to  Levine  et  al  (1997),  a  VIF  greater  than  10  indicates  there  is  too 
much  correlation  between  the  independent  variables.    In  the  third  regression  model,  all 
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VIF  values  were  less  than  10.  Therefore,  the  third  regression  model  was  fully  optimized 
and  verified  and  was  chosen  as  the  final  model  to  compare  to  the  two  neural  networks. 

With  three  working  forecasting  models,  the  next  step  was  to  calculate  the 
probability  that  each  model's  prediction  will  be  accurate.  The  calculation  was  based 
upon  Bayes'  Theorem,  or  conditional  probability.  Bayes'  Theorem  states  that  a 
probability  depends  upon  the  environment  in  which  it  is  based.  A  conditional  probability 
is  stated  as  given  X  what  is  the  probability  of  Y  or  P(Y\X) .  First  the  researcher  had  to 
find  something  that  could  easily  be  identified  in  the  environment.  It  would  be  tedious  to 
try  and  calculate  probabilities  for  individual  S&P500  closing  values  or  individual  percent 
changes.  However,  one  could  calculate  the  number  of  times  the  market  rose  or  fell;  this 
is  potentially  enough  information  for  the  investor.  The  market  rise  or  fall  corresponds  to 
percent  change,  which  is  the  output  of  the  Percent  Network.  Percent  changes  can  also  be 
calculated  from  the  output  of  the  Close  Network  and  the  Regression  Model. 

Therefore,  the  question  used  to  calculate  the  probability  that  each  model's 
prediction  is  accurate  is:  given  a  certain  amount  of  historical  daily  market  rises,  when  a 
model    predicts   a   market   rise,    what   is   the   probability   of  it   actually    occurring. 

Mathematically  this  would  be  stated  as  P(ForecastedRise  \  HistoricalRise) .   Rather  than 

using  the  mathematical  form  of  Bayes'  Theorem,  the  conditional  probability  was 
calculated  in  a  spreadsheet  using  a  method  described  by  Dr.  Katsuaki  Terasawa  of  the 
Naval  Postgraduate  School.  First,  the  historical  data  was  calculated  within  Excel  from 
the  raw  data  during  the  period  from  March  3,  1991  to  August  18,  1998.    An  if-then 

30 


statement  was  used  to  identify  a  percentage  rise.  The  statement  generates  a  one  if  the 
percent  change  is  greater  than  zero  or  a  zero  if  the  percent  change  is  less  than  zero. 
Slimming  this  column  provides  the  total  days  with  a  percent  increase.  This  was 
subtracted  from  the  total  number  of  days  in  the  data  set  to  identify  market  falls.  The 
number  of  times  the  market  rose  and  fell  was  calculated. 

Next,  the  accuracy  of  each  model  was  calculated.  The  output  of  each  model  for 
the  out  of  sample  data  was  used.  The  if-then  technique  was  used  to  identify  when  both 
the  model  forecast  and  the  actual  data  agreed  or  disagreed  as  to  a  market  rise  or  fall.  This 
data  could  be  entered  into  Bayes'  theorem  to  obtain  the  conditional  probability.  However 
the  accuracy  of  the  model  was  adjusted  using  the  historical  environmental  data  as 
described  by  Professor  Terasawa.  Calculating  the  probability  of  accurately  predicting  a 
rise  or  fall  in  the  S&P500  Index  became  a  simple  matter  of  dividing  accurate  rise  or  fall 
predictions  by  total  rise  or  fall  predictions. 
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IV.  PRESENTATION  OF  DATA  COLLECTED 

In  this  section  the  research  data  will  be  presented  and  important  items  will  be 
identified.  The  presentation  begins  with  vital  data  for  each  of  the  forecasting  models, 
follows  with  the  historical  probabilities,  and  concludes  by  presenting  conditional 
probabilities. 

A.         CLOSE  NETWORK 

The  following  vital  data  given  in  Table  1  and  Figures  6  and  7  is  from  the 
completed  training  module: 


Table  1.  Training  Module  Output  Close  Network 


Training  Set 

Test  Set 

Learning  events 

559800 

N/A 

Learning  epochs 

1446 

N/A 

Minimum  average  error 

0.0002282 

0.0002896 

Training  Time 

02:37  Minutes 
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Figure  6.  Training  Error  on  Close  Network  Training  Set 
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Figure  7.  Training  Error  on  Close  Network  Test  Set 


The  trained  network  was  applied  to  the  99  out  of  sample  test  patterns.    The  results  are 
shown  in  Table  2. 
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Table  2.  Close  Network  Output  Statistics 


R  squared 

0.9935 

r  squared 

0.9935 

Mean  squared  error 

130.975 

Mean  absolute  error 

8.821 

Min.  absolute  error 

0.039 

Max.  absolute  error 

31.792 

Correlation  coefficient  r 

0.9968 

Percent  within  5% 

100 

Percent  within  5%  to  10% 

0 

Percent  within  10%  to  20%> 

0 

Percent  within  20%  to  30% 

0 

Percent  over  30% 

0 

Figure  8  is  a  graphical  depiction  of  how  the  Close  Network  weighted  the  contribution  of 
each  input  to  the  model. 
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Figure  8.  Input  Contribution  Factors  Close  Network 
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Figure  9  is  a  graphical  depiction  of  the  Close  Network's  forecast  versus  the  actual 
S&P500  Close. 
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Figure  9.  Close  Network  Actual  vs  Predicted  S&P500  Close 
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Figure  10  is  a  graphical  depiction  of  the  Close  Network's  forecast  error. 
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Figure  10.  Close  Network  Error 


The  Close  Network  error  was  input  into  Excel  and  the  Descriptive  Statistics  tool  was 
used  to  generate  Table  3. 


Table  3.  Close  Network  Descriptive  Statistics 


Mean 

0.175905208 

Standard  Error 

1.167902939 

Median 

-0.257263184 

Standard 
Deviation 

11.50250998 

Sample  Variance 

132.3077358 
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Table  3  (Continued) 


Kurtosis 

0.240087928 

Skewness 

0.050247272 

Range 

61.15527344 

Minimum 

-31.79174805 

Maximum 

29.36352539 

Sum 

17.06280518 

Count 

97 

Confidence 
Level(95.0%) 

2.318270784 

B.         PERCENT  NETWORK 

The  following  vital  data  given  in  Table  4  and  Figures  11  and  12  is  from  the 
completed  training  module: 


Table  4.  Training  Module  Output  Percent  Network 


Training  Set 

Test  Set 

Learning  events 

221400 

N/A 

Learning  epochs 

572 

N/A 

Minimum  average  error 

0.0016160 

0.0026779 

Training  Time 

01:14  Minutes 
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Figure  11.  Training  Error  on  Percent  Network  Training  Set 
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Figure  12.  Training  Error  on  Percent  Network  Test  Set 


The  trained  network  was  applied  to  the  99  out  of  sample  test  patterns.    The  results  are 
shown  in  Table  5. 


Table  5.  Percent  Network  Output  Statistics 


R  squared 

0.7872 

r  squared 

0.7933 

Mean  squared  error 

1.449 

Mean  absolute  error 

0.919 
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Table  5  (Continued) 


Min.  absolute  error 

0.006 

Max.  absolute  error 

4.484 

Correlation  coefficient  r 

0.8907 

Percent  within  5% 

10.309 

Percent  within  5%  to  10% 

6.186 

Percent  within  10%  to  20% 

20.619 

Percent  within  20%  to  30% 

11.340 

Percent  over  30% 

51.546 

Figure  1 3  is  a  graphical  depiction  of  how  the  Percent  Network  weighted  the  contribution 
of  each  input  to  the  model. 
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Figure  13.  Input  Contribution  Factors  Percent  Network 
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Figure  14  is  a  graphical  depiction  of  the  Percent  Network's  forecast  versus  the  actual 
S&P500  Close. 
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Figure  14.       Percent  Network  Actual  vs.  Predicted  Future  10  Day  Percent  Change 
and  Closing  Price  of  S&P500 
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Figure  15  is  a  graphical  depiction  of  the  Percent  Network's  forecast  error. 
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Figure  15.  Percent  Network  Error 


The  Percent  Network  error  was  input  into  Excel  and  the  Descriptive  Statistics  tool  was 
used  to  generate  Table  6. 
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Table  6.  Percent  Network  Descriptive  Statistics 


Mean 

-1.081002006 

Standard  Error 

1.107737379 

Median 

-0.437339914 

Standard 
Deviation 

10.90994792 

Sample  Variance 

119.0269637 

Kurtosis 

1.792340417 

Skewness 

0.530272064 

Range 

68.62393946 

Minimum 

-26.16139546 

Maximum 

42.462544 

Sum 

-104.8571946 

Count 

97 

Confidence 
Level(95.0%) 

2.198842999 

Figure  16  is  a  graphical  depiction  of  the  both  the  Close  and  Percent  Network's  forecast 
versus  the  actual  S&P500  Close. 
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Figure  16.  All  Network  Models  Actual  vs.  Predicted  S&P500  C 

Figure  17  is  a  graphical  depiction  of  both  the  Percent  Network  and  Close  Network 
forecast  error. 
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Figure  17.  S&P500  Closing  Value  Prediction  Neural  Network  Model  Error  Chart 

C.         MULTIPLE  LINEAR  REGRESSION  MODEL 

Multiple  linear  regression  analysis  was  performed  using  the  Data  Analysis  tool 
within  Excel.  The  output  of  this  process  for  the  final  model  is  presented  in  Table  7. 


Table  7.  Regression  Statistics 


Multiple  R 

0.983432302 

R  Square 

0.967139093 

Adjusted  R  Square 

0.96679536 

Standard  Error 

25.81440036 

Observations 

484 
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Table  7  (Continued) 


ANOVA 

Df 

SS 

MS 

F 

Regression 

5 

9374786.243 

1874957.249 

2813.63195 

Residual 

478 

318531.2012 

666.3832661 

Total 

483 

9693317.444 

Coefficients 

Standard  Error 

tStat 

P-value 

Intercept 

1523.248565 

96.30217982 

15.81738407 

1.25634E-45 

Dow 

Transportation 
Index  C 

0.173215277 

0.008063272 

21.48200959 

3.79263E-72 

Dow  Utilities 
Index  C 

-0.512956407 

0.157214185 

-3.262787046 

0.00118219 

Amex  Oil 
Index  C 

1.455027957 

0.117440864 

12.38945207 

9.13351E-31 

CRBC 

-5.159128047 

0.28529288 

-18.08362007 

4.48872E-56 

Lag(10)of 
Amex  Oil 

Index  C 



-0.902950239 

0.106686284 

-8.463601907 

3.19588E-16 

Excel  was  also  used  to  calculate  the  Variance  Inflationary  Factor  (VIF).   The  results  are 
given  below  in  Table  8. 
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Table  8.  VIF  for  Regression  Inputs 


Dependant  Variable 

R  Square 

Variance  Inflationary 
Factor  (VIF) 

Dow  Transportation  Index  C 

0.918384 

6.39 

Dow  Utilities  Index  C 

0.911393 

5.90 

Amex  Oil  Index  C 

0.942674 

8.98 

CRBC 

0.855026 

3.72 

Lag(lO)  of  Amex  Oil  Index  C 

0.936325 

8.11 

The  Normal  probability  plot,  Line  Fit  Plots,  and  Residual  Plots  for  the  Multiple 
Regression  Model  are  provided  in  Appendix  A.  Figure  1 8  is  a  graphical  depiction  of  the 
Multiple  Regression  Model's  forecast  versus  the  actual  S&P500  Close. 


1200 


1100 


1000 


>   900 


800 


700 


600 


Time  (trading  days) 


Actual 
S&P500  C 


Predicted 

S&PS00 

Close  using 

Third 

Regression 

Analysis 


Figure  18.  Regression  Model  Predicted  vs.  Actual  S&P500  Close 
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Figure  19  is  a  graphical  depiction  of  the  Multiple  Regression  Model's  forecast  error. 
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Figure  19.  Regression  Model  Error  Chart 

The  Regression  Model  error  was  input  into  Excel  and  the  Descriptive  Statistics  tool  was 
used  to  generate  Table  9. 


Table  9.  Regression  Model  Descriptive  Statistics 


Mean 

0.291446988 

Standard  Error 

2.533807729 

Median 

0.001038339 

Standard 
Deviation 

24.95511202 

Sample  Variance 

622.7576161 
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Table  9  (Continued) 


Kurtosis 

0.138974197 

Skewness 

0.071861212 

Range 

130.4937839 

Minimum 

-56.84815562 

Maximum 

73.64562832 

Sum 

28.27035783 

Count 

97 

Confidence 
Level(95.0%) 

5.029572436 

Figure  20  is  a  graphical  depiction  of  all  mode  forecasts  versus  the  actual  S&P500  Close. 
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Figure  20.  Actual  vs.  AH  Model  Predictions  of  S&P500  Close  Ten  Days  Into  Future 
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Figure  2 1  is  a  graphical  depiction  of  all  models'  forecast  error. 
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Figure  21.  All  Model  Error  Chart 

D.         CONDITIONAL  PROBABILITY 

Historical  data  was  calculated  for  the  number  of  times  the  market  rose  and  fell 
during  the  period  from  March  3rd,  1991  to  August  18th,  1998.  The  data  in  Table  10 
applies: 

Table  10.  Historical  Market  Data 


INITIAL  KNOWLEDGE 

Total  Days  the  S&P500  Rose 

1173 

Total  Days  the  S&P500  Fell 

696 

Total  Days 

1869 
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The  accuracy  of  each  model  was  then  calculated.    The  data  in  Tables  11,  12,  and  13 
apply: 


Table  11.  Close  Network  Accuracy 


Accuracy  of 
Model 

States  of  Nature 

Rise 

Fall 

Total 

Rise 

62 

6 

68 

Close  Network  Model 

Fall 

6 

23 

29 

Total 

68 

29 

97 

Table  12.  Percent  Network  Accuracy 


Accuracy  of 
Model 

States  of  Nature 

Rise 

Fall 

Total 

Rise 

65 

3 

68 

Percent  Network  Model 

Fall 

5 

24 

29 

Total 

70 

27 

97 
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Table  13.  Multiple  Regression  Accuracy 


Accuracy  of 
Model 

States  of  Nature 

Rise 

Fall 

Total 

Rise 

54 

14 

68 

Multiple  Regression 
Model 

Fall 

15 

14 

29 

Total 

69 

28 

97 

The  model  accuracy  was  then  adjusted  using  the  environmental  data.  The  data  in 
Tables  14,  15,  and  16  apply: 


Table  14.  Close  Network  Environmental  Adjustment 


Adjustment 

States  of  Nature 

Rise 

Fall 

Total 

Rise 

1069.5 

144 

1213.5 

Close  Network  Model 

Fall 

103.5 

552 

655.5 

Total 

1173 

696 

1869 
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Table  15.  Percent  Network  Environmental  Adjustment 


Adjustment 

States  of  Nature 

Rise 

Fall 

Total 

Rise 

1089.21 

77.3333 

1166.54 

pPercent  Network  Model 

Fall 

83.7857 

618.666 

702.452 

Total 

1173 

696 

1869 

Table  16.  Multiple  Regression  Environmental  Adjustment 


Adjustment 

States  of  Nature 

Rise 

Fall 

Total 

Rise 

918 

348 

1266 

Multiple  Regression 
Model 

Fall 

255 

348 

603 

Total 

1173 

696 

1869 

Finally  the  prediction  accuracy  probability  was  calculated  for  each  model.  The 
data  in  Tables  17,  18,  and  19  apply. 
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Table  17.  Close  Network  Accuracy  Probability 


Prediction 

Probability 

Close  Network  Model 

Market 
Rise 

88.1335 

Market 
Fall 

84.21053 

Table  18.  Percent  Network  Accuracy  Probability 


Prediction 

Probability 

Percent  Network  Model 

Market 
Rise 

93.37075 

Market 
Fall 

88.0724 

Table  19.  Multiple  Regression  Accuracy  Probability 


Prediction 

Probability 

Multiple  Regression 
Model 

Market 
Rise 

72.51185 

Market 
Fall 

57.71144 
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V.  DATA  ANALYSIS  AND  INTERPRETATION 


Model  accuracy  can  be  compared  across  the  three  models  for  the  following 


characteristics: 


Coefficient  of  Multiple  Determination. 


Combined  Actual  vs.  Predicted  S&P500  Close  Chart. 


Error  statistics,  specifically  the  mean  and  standard  deviation. 


All  Model  Error  Chart. 


Conditional  Probabilities. 


Table  20  compares  the  ranked  Coefficients  of  Multiple  Determination  for  each 


model: 


Table  20.  Coefficients  of  Multiple  Determination 


Model 

R  square 

Close  Network 

.9935 

Regression  Model 

.9671 

Percent  Network 

.7872 

The  R  square  value  represents  the  proportion  of  variation  in  the  dependant  variable  that  is 
explained  by  the  independent  variables.  The  better  the  model  explains  variation  in  the 
dependant  variable,  the  higher  the  R  square  value.  Without  further  comparison,  the  Close 
Network  best  explains  variation  in  the  dependant  variable,  followed  by  the  Regression 
Model. 
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In  examining  Figure  20,  Actual  vs.  All  Model  Predictions  of  S&P500  Close  Ten 
Days  into  the  Future,  it  is  relatively  easy  to  visually  verify  that  the  two  network  models 
perform  better  than  the  regression  model.  This  differs  from  the  model  ranking  due  to  R 
square  values.  Both  network  models  predict  the  closing  value  relatively  accurately. 
However,  it  is  difficult  visually  to  determine  which  of  these  is  more  accurate. 

In  Table  21,  the  ranked  error  statistics  are  provided  for  comparison.  These 
statistics  are  all  based  on  closing  price  error.  The  Percent  Network  error  was  converted  to 
closing  price  error,  so  it  could  be  compared  to  the  other  two  models. 

Table  21.  Model  Error  Statistics 


Model 

Mean 

Standard 
Deviation 

Percent  Network 

-1.08 

10.9 

Close  Network 

.1759 

11.50 

Regression  Model 

.2914 

24.95 

Ideally,  the  mean  error  would  be  zero  and  the  standard  deviation  would  be  as  small  as 
possible.  All  of  the  models'  means  are  relatively  close  to  zero.  However,  the  breakout 
occurs  with  standard  deviation.  Generally  it  can  be  said  that  there  is  a  95.44  percent 
probability  of  the  error  values  falling  within  two  standard  deviations  of  the  mean. 
Therefore,  the  larger  the  standard  deviation  the  greater  the  range  of  error.  Although  it  has 
a  lower  coefficient  of  determination,  the  Percent  Network  is. more  accurate.  This  tends  to 
support  the  theory  that  predicting  a  percent  change  is  more  accurate  than  predicting  the 
closing  value. 
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Visually  examining  Figure  21,  All  Model  Error  Chart,  clearly  shows  the 
Regression  Model  has  the  greatest  error  variation.  Differentiation  between  the  two 
network  models  is  difficult,  suggesting  that  the  error  statistics  should  provide  the  true 
ranking. 

The  final  ranking  test  is  the  conditional  accuracy  probabilities  for  each  model. 
Table  22  summarizes  and  ranks  these  probabilities  for  easy  comparison. 

Table  22.  Conditional  Probabilities 


Probability  of  Accurately 
Predicting 

Model 

Market  Rise 

Market  Fall 

Percent  Network 

93.37 

88.07 

Close  Network 

88.13 

84.21 

Regression  Model 

72.5 

57.71 

Clearly,  the  prediction  probabilities  support  the  error  statistics  rankings  and  verify  that 
the  Percent  Network  is  the  most  accurate  predictor  of  the  S&P500  closing  price. 
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VI.  CONCLUSIONS  AND  RECOMMENDATIONS 

A.         CONCLUSIONS 

It  is  clear  from  the  model  accuracy  probabilities  that  neural  networks  can 
accurately  predict  financial  markets  if  given  the  proper  data  upon  which  to  train.  When 
compared  to  regression  analysis,  neural  networks  are  a  better  tool  for  the  investor  for  the 
following  reasons: 


• 


When  using  multiple  linear  regression,  the  governing  regression 
assumptions  must  be  true.  The  linearity  assumption  itself  may  not  hold  in 
many  cases.  Neural  networks  can  model  both  linear  and  curvilinear 
systems. 

•  When  using  multiple  linear  regression  analysis,  the  investor  must  have  a 
deep  understanding  of  statistics  to  ensure  only  the  necessary  independent 
variables  are  used.  This  is  true  only  to  a  limited  degree  with  neural 
networks  and  can  be  mitigated  by  the  systematic  removal  method 
described  by  Jurik  in  Virtual  Trading. 

•  For  the  models  studied  in  this  research,  neural  networks  are  significantly 
more  accurate  than  multiple  linear  regression  analysis. 

However,  the  difficulty  in  identifying  good  raw  data,  preprocessing  this  data,  training  a 
network  and  repeating  this  process  until  a  good  model  is  developed  should  not  be 
discounted.  The  individual  investor  should  be  warned  that  model  accuracy  is  difficult  to 
obtain  and  can  take  months  or  years  of  investigation. 

B.         RECOMMENDATIONS 

For  individual  investors  to  successfully  use  neural  networks  to  predict  financial 
markets,  they  must  undertake  the  following: 
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•  As  a  minimum,  read  a  basic  text  on  neural  networks  to  understand  neural 
network  theory  and  its  limitations. 

•  Understand  basic  statistical  measures  and  probability. 


• 


• 


Become  extremely  proficient  with  a  spreadsheet  software  program  so  that 
data  can  be  preprocessed  efficiently. 

Study  financial  market  theory  so  that  input  data  to  the  neural  net  is  not 
chosen  inappropriately  or  at  random. 

•  Obtain  a  neural  network  software  program  and  test  and  evaluate  many 
neural  networks.  Practice  by  varying  inputs  and  studying  the  effects  on 
outputs. 

•  Once  a  network  is  developed,  do  not  blindly  follow  its  advice.  As  Gately 
(1996)  states,  try  to  verify  it  with  other  indicators  before  taking  action.  In 
other  words  use  multiple  indicators.  This  could  include  using  multiple 
networks  incorporating  different  inputs  to  predict  the  same  output. 

Only   by   meticulously   following   these   recommendations   will   individual   investors 
improve  their  potential  profits  by  using  neural  networks. 

Although  outside  the  scope  of  this  research,  an  important  question  for  any 
forecasting  model  is  how  does  the  model  stand  up  in  an  actual  trading  scenario?  Each  of 
these  models  should  be  historically  tested  as  if  being  used  for  actual  trading.  Given  the 
same  initial  capital  investment,  what  is  the  return  for  each  of  these  models?  What  is  the 
maximum  drawdown  or  capital  loss  for  each  of  these  models?  If  a  model  has  a  high 
return  is  it  due  to  many  steady  small  gains  or  is  it  due  to  one  huge  gain  surrounded  by 
many  losses?  These  issues  revolve  around  profit  and  not  model  accuracy.  This  raises  the 
question  of  whether  it  is  important  to  design  a  network  and  train  it  to  maximize  profit  vs. 
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forecasting  accuracy?    These  are  all  critical  questions  that  take  the  forecasting  model 
from  academic  research  into  the  actual  world  of  trading. 
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APPENDIX  A.  THIRD  REGRESSION  PARTIAL  OUTPUT  AND  VITAL  PLOTS 
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APPENDIX  B.  PARTIAL  LISTING  OF  RAW  AND  PREPROCESSED  INPUT  DATA 


Raw  Data 

Dow 

Dow 

Amex 

Dow 

Gold  and 

S&P500 

S&P500 

S&P500 

Transportation 

Utilities 

Oil 

Industrial 

Silver 

Date 

H 

L 

C 

Index  C 

Index  C 

Index  C 

CRBC 

Index  V 

Mining  C 

3/1/91 

370.468 

363.729 

370.468 

1150.739 

213.339 

252.5 

217.94 

272472 

86.86 

3/4/91 

371.989 

369.07 

369.33 

1142.449 

212.02 

250.34 

219.69 

214533 

89.35 

3/5/91 

377.887 

369.33 

376.718 

1166.26 

213.85 

253.58 

220.82 

283650 

87.93 

3/6/91 

379.657 
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116.9 

99.15 

1464)28843 

X02020202 

707 

307511.0938 

245.1399994 

354.73 

2063  899902 

7.757575512 

-3.094447136 

9930999756 

35342 

702 

693 

701 

2102.14 

221.91 

367.08 

245.97 

399449 

11711 

99.64 

2.037843706 

1 426533524 

711 

309239.9375 

2444199982 

356.8699951 

2100.709961 

1418181801 

-1.023538802 

9944999695 

35345 

704 

701 

703 

2085-3 

22X19 

370.89 

247.81 

268X23 

117X2 

10217 

2478134111 

0.995732575 

710 

309709.4063 

243.8399963 

355X099913 

2085.590088 

1933333206 

0.683979213 

9831999969 

35346 

706 

700 

701 

2076.17 

222.68 

371.5 

249.14 

419760 

117.66 

102.18 

2186588921 

0.855920114 

707 

3160093623 

2453099976 

355.8900146 

2071,889893 

2133333397 

X280534744 

10X6699982 

35347 

702 

694 

697 

2049.63 

221.49 

368X1 

248.61 

357745 

118.16 

104.04 

1.603498542 

143472023 

707 

321256.9063 

247.1199951 

3544500122 

207)600098 

1933333206 

3  15290904 

103.6100006 

33348 

697 

693 

693 

2058.48 

220.16 

367.53 

24738 

267421 

119  38 

10X61 

131 1953353 

1.007194245 

702 

322475.4373 

2464900055 

354X600098 

2048.77002 

14.909091 

343301652 

1 033099976 

35349 

701 

695 

701 

2075.89 

221.49 

370.71 

245.7 

236864 

117.88 

105.13 

2186388921 

0 

701 

321438.3 

246.6399994 

3553599854 

2067.040039 

1X66666603 

3393572807 

101  8600006 

35352 

705 

701 

704 

2038.05 

221.56 

374.71 

245.49 

274236 

116.39 

107.02 

X474526929 

■0.994318182 

697 

323219.7188 

245.6300049 

356,1499939 

2079.02002 

10.909091 

3  079185486 

100.5899963 

35353 

708 

699 

703 

2105.28 

221.7 

373.58 

246X4 

377247 

117.23 

107.11 

X03 1930334 

-0.142247311 

702 

325853.5938 

244.1999969 

359  7799988 

2084.159912 

7.878787994 

2393883703 

98.76999664 

35354 

704 

699 

704 

2097.07 

221J5 

37X82 

244.41 

346812 

117.14 

106.94 

1.44092219 

-0426136364 

701 

328301.4063 

244  6399994 

3625799866 

2093.01001 

7.03O3030OI 

1.872404218 

100 

35355 

709 

705 

707 

2101.47 

222.89 

375X4 

244.12 

343285 

115.16 

1 06.04 

X02020202 

-0.282883431 

705 

33219X6875 

245.8399963 

36)369995) 

2079.879883 

5.939393997 

1363754559 

99.15000133 

35336 

711 

706 

711 

2116.42 

224.57 

380.46 

243.35 

399401 

114 

10593 

1426533524 

-0.984528833 

704 

336099.0938 

245.9700012 

367.0799866 

2102139893 

10.66666698 

1.125685453 

99.63999939 

33339 

714 

708 

710 

2115.24 

223.52 

380.69 

243.83 

419587 

116.64 

104.01 

0.995732575 

-042X535211 

707 

34178X5313 

247.8099976 

370.8900146 

2085300049 

14.969697 

0.79283762 

102.1699982 

33360 

710 

705 

707 

2123.6 

223.66 

380.84 

244.96 

294423 

118.6 

102X8 

0.855920114 

0.99009901 

714 

340644.9688 

249.1399994 

37)  5 

2076.169922 

15.45454502 

0343300909 

102.1800003 

33361 

707 

701 

707 

21 53.35 

223.1 

378  J  8 

244.11 

374775 

1 19.25 

10498 

143472023 

X345968883 

725 

3436644375 

248.6100006 

368X0999)5 

2049.629883 

1X54545403 

0.137952268 

104.0400009 

35362 

708 

702 

702 

2137.81 

222.89 

372.94 

241.9 

345876 

119.17 

103X6 

1.007194245 

3.703703704 

728 

345519.1873 

2473800049 

367.5299988 

205847998 

4363636494 

-0.671291292 

102.6100006 

35363 

704 

701 

701 

2126.68 

223  J 1 

374.56 

243.26 

259776 

1 18.98 

10X03 

0 

4X79600571 

731 

342038.5623 

245.6999969 

370.7099915 

2075.889893 

•1X12121248 

-1.36627059 

103  1299973 

35366 

70S 

697 

697 

2105.37 

22X75 

373X8 

24333 

302628 

119.1 

101.16 

•0.994318182 

3.021320803 

732 

341093.8438 

2454900055 

374.7099915 

2058.050049 

-6.969696999 

-X7I323967 

107.0199966 

35367 

703 

696 

702 

2097.95 

224.5 

376.68 

241.11 

322806 

116.18 

99X3 

-0.142247311 

3.988603989 

730 

339128.4688 

2462400033 

373.5799866 

2105.280029 

-9.818181992 

-2875000477 

107  1100006 

35368 

703 

700 

701 

2096.63 

225.19 

375.66 

241.66 

302549 

117.72 

100.32 

-0426136364 

4.279600371 

731 

33781X3438 

2444100037 

37X8200073 

2097.070061 

•  1X42424202 

-3419759274 

106.9400024 

35369 

707 

700 

705 

2133.56 

226.73 

371.88 

237.83 

370338 

115.6 

101.67 

•0.282885431 

4397163t21 

736 

339609.9375 

244.1199951 

375X399902 

2101  469971 

•  10.48484802 

-3.006703854 

106  0400009 

35370 

709 

701 

704 

2137.52 

22645 

366.85 

2373 

370297 

1 1638 

10138 

•0.984528833 

4.829545455 

738 

3353454063 

2433500061 

3804599915 

2)16419922 

-6.181818008 

-3328475237 

105.9499969 

35373 

707 

703 

707 

2154 .23 

228.48 

365.87 

236.52 

373148 

116.71 

10X53 

-0422333211 

4X43281471 

737 

340013.4063 

243.8300018 

380.6900024 

2115.23999 

-0.060606059 

-3.099)60194 

104.0100021 

35374 

713 

707 

714 

2147.78 

231.41 

363.41 

236.13 

405603 

1 15.88 

10549 

0.99009901 

3.921568627 

742 

33746X5 

244.9600067 

380.8399963 

2123.600098 

8.242424011 

•  1483215928 

102X799988 

35375 

725 

713 

725 

2161.9 

234.07 

367  34 

237.03 

460107 

113.44 

109X8 

2543968883 

2620689655 

744 

3404043125 

244.1100006 

3783800049 

2153  350098 

21.69696999 

1.996910572 

104.9800034 

35376 

729 

722 

718 

2179.4 

233.68 

368.93 

238.74 

396778 

1 16.88 

11X08 

3.703703704 

X060439S6 

743 

341373.0625 

241.8999939 

37X9400024 

2137.810059 

31X7272797 

3.942640305 

103.2600021 

35377 

731 

725 

731 

2183.69 

234.77 

37X26 

239.72 

323583 

118.63 

11X47 

4.279600371 

2462380301 

749 

3424253313 

243X599945 

374.5599976 

2126.679932 

38.66666412 

9.054610252 

10X0299988 

35380 

733 

730 

732 

2198.89 

234.77 

373.99 

240.64 

307184 

120.91 

113X5 

5.021520803 

3415300546 

757 

343316.2813 

2433300018 

373.2799988 

2105  570068 

4030303192 

11.21364594 

101.1600037 

35311 

733 

728 

730 

2221.76 

234  x  1 

37X75 

240.49 

460850 

126.07 

113.03 

3.988603989 

3.561643836 

756 

347176,8123 

241.1100006 

376.6799927 

2097  94995) 

39.93939209 

121333783 

99.23000336 

35382 

732 

728 

731 

2216.85 

23X88 

373.12 

242.33 

396548 

127 J 

114.89 

4.279600571 

3X83173735 

755 

348857.5625 

241.6600037 

375.6600037 

2096.6X9883 

36.060604) 

1234069729 

100.3199966 

33383 

736 

729 

736 

2228.82 

233.16 

375.95 

243.4] 

412578 

125.19 

11738 

4397163121 

X85326087 

757 

35306X5625 

237.8300018 

371.8800049 

2133.360039 

33.9393939 

1194963741 

101.6699982 

33384 

742 

735 

738 

2221.43 

234.91 

377.06 

244.7 

506851 

125.07 

11539 

4.829545455 

X574525745 

757 

35664X625 

237300003) 

366.8500061 

2137.52002 

28  48484802 

10.51314449 

1013799973 

35387 

739 

734 

737 

2242.63 

233.37 

37996 

244.47 

312979 

12247 

1143 

4.243281471 

1492537313 

748 

358134.5 

2363200043 

365.8699951 

2154.22998 

20.36363602 

8.019536973 

1023299988 

33388 

742 

737 

742 

2237.06 

234.49 

383.86 

245.51 

347465 

12X33 

116.5 

3.921 56  8627 

0404312668 

745 

355724.6563 

236.1300049 

3634100037 

2147.780029 

16 

3643541813 

103  4899979 

33389 

747 

740 

744 

2273.63 

234.63 

383.17 

246.19 

385708 

126.36 

1 17.05 

2.620689655 

0 

744 

356656.7813 

237.0299988 

3673399963 

2161  899902 

16.66666603 

2.941775322 

109.2799988 

35390 

743 

741 

743 

2238.9 

234.49 

382.91 

245.68 

362483 

120  82 

1 1647 

206043936 

-0  403768506 

740 

3398255 

238.7400035 

3689299927 

2179399902 

16.48484802 

0.731117249 

1120800018 

33391 

749 

743 

749 

226534 

233.4 

388.2 

244  19 

328139 

119.75 

121.67 

X46  2380301 

0  133511348 

750 

362868 

239.7200012 

37X2600098 

2183.68994] 

1975757599 

-0333522797 

1124700012 

33394 

737 

748 

757 

2289.75 

238.12 

393.01 

243  J 1 

339053 

117.88 

121.23 

3  413300546 

-I  188903567 

748 

3650283625 

240.6399994 

373  9899902 

2198.889893 

25.87878799 

0413188219 

113.25 

33395 

762 

753 

756 

2282.23 

236.44 

391.31 

244.85 

509978 

11996 

12X05 

3.561643836 

-1984126984 

741 

36945X9375 

240.4900055 

37X73 

2221.76001 

27  09090996 

0.677389145 

115.0500031 

35396 

757 

753 

733 

2272.71 

233.61 

38646 

244.65 

291974 

120.23 

124.67 

3.283173733 

-3443708609 

729 

367625 

2423300018 

373  1199951 

2216  850098 

25X7272797 

1.020736217 

114.8899994 

35398 

758 

755 

737 

2290.82 

233.68 

388.88 

243.36 

122134 

120.19 

125 

X85326087 

-3.698811096 

729 

3602533125 

2434100037 

375.9500122 

2228  820068 

24.96969604 

1.258088112 

1173799973 

35401 

757 

751 

737 

2293.89 

234.77 

391.04 

24202 

312236 

117.02 

127.67 

X574325743 

-4.755614267 

721 

357347.8125 

244.6999969 

377.0599976 

2221.44995) 

2345454407 

1.893194914 

1153899994 

35402 

762 

748 

748 

2300.06 

23313 

389.04 

24163 

383890 

115.19 

127.16 

1492337313 

•X94 1176471 

726 

356157.9063 

244  4700OI2 

379  95999)5 

2242.629883 

14.060606 

1432389)54 

1143000031 

35403 

748 

738 

743 

2308.38 

233.31 

385.4 

24 1.37 

449031 

118.99 

127.66 

0.404312668 

•1  744966443 

732 

36131 1.5 

245.5099945 

383  8599854 

2237.060059 

5.03030300) 

0.247)22347 

116.5 

35404 

748 

743 

744 

2313.47 

233.86 

390.39 

243.35 

369025 

12X13 

126.21 

0 

0X68817204 

746 

3611198438 

246.1900024 

383.1700134 

2273  629883 

-3.575737504 

•  1.82779336 

117.0500031 

35405 

744 

727 

740 

2274.16 

231.48 

385.7 

242.06 

486585 

121.58 

12547 

-O.403768306 

1X16216216 

749 

365810.125 

2456799927 

38X9100037 

2258.899902 

•  15  030303 

4.287372589 

1164700012 
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APPENDIX  C.  SOURCE  CODE  FOR  CLOSE  NETWORK 


Note  -  use  this  code  with  your  calculator  or  spreadsheet  to  fire  the 

C:\24XLANUASON\SCHOOL\THESIS\SP500M~4\SP1NET~1\SP12NET\SP12NET 

network 

Note  -  the  following  are  intermediate  value  cells  and  arrays: 

Note  -  parens  immediately  below  denote  an  array  where  the  number  of  elements  is  in 

parens 

netsum 
feature2(9) 
fearure3(9) 
feature4(9) 

Note  -  the  following  are  names  of  inputs  and  outputs: 

Note-inp(l)isS&P500_H 

Note  -  inp(2)  is  S&P500_L 

Note  -  inp(3)  is  S&P500_C 

Note  -  inp(4)  is  Dow_Transportation_Index_C 

Note  -  inp(5)  is  Dow_Utilities_Index_C 

Note  -  inp(6)  is  Amex_Oil_Index_C 

Note  -  inp(7)  is  CRB_C 

Note  -  inp(8)  is  Gold_and_Silver_Mining_C 

Note  -  inp(9)  is  GSM_C 

Note  -  outp(l)  is  Future_(10_days)_S&P500_C 

Note  -  inp(10)  is  MvAvg(30)_of_Dow_Industrial_Index_V 

Note  -  inp(l  1)  is  Lag(10)_of_CRB_C 

Note  -  inp(12)  is  Lag(10)_of_Amex_Oil_Index_C 

Note  -  inp(13)  is  Lag(10)_of_Dow_Transportation_Index_C 

Note  -  inp(14)  is  Lag(10)_of_GSM_C 

if(inp(l)<  629)  then  inp(l)=  629 
if  (inp(l)>  1191)  then  inp(l)  =1191 
inp(l)  =  2  *  (inp(l)  -  629)  /  562  -1 

if(inp(2)<  616)  then  inp(2)  =  616 
if  (inp(2)>  1 1 82)  then  inp(2)  =1182 
inp(2)  =  2  *  (inp(2)  -  616)  /  566  -1 

if(inp(3)<  627)  then  inp(3)  =  627 
if  (inp(3)>  1 1 87)  then  inp(3)  =1187 
inp(3)  =  2  *  (inp(3)  -  627)  /  560  -1 

if  (inp(4)<  1965.73)  then  inp(4)  =  1965.73 
if  (inp(4)>  3686.02)  then  inp(4)  =  3686.02 
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inp(4)  =  2  *  (inp(4)  -  1965.73)  / 1720.29  -1 

if  (inp(5)<  204.86)  then  inp(5)  =  204.86 
if  (inp(5)>  295.4)  then  inp(5)=  295.4 
inp(5)  =  2  *  (inp(5)  -  204.86)  /  90.53999  -1 

if  (inp(6)<  330.48)  then  inp(6)  =  330.48 
if  (inp(6)>  503.75)  then  inp(6)  =  503.75 
inp(6)  =  2  *  (inp(6)  -  330.48)  / 173.27  -1 

if  (inp(7)<  202.02)  then  inp(7)  =  202.02 
if  (inp(7)>  253.96)  then  inp(7)  =  253.96 
inp(7)  =  2  *  (inp(7)  -  202.02)  /  51.94  -1 

if(inp(8)<  60.32)  then  inp(8)  =  60.32 
if  (inp(8)>  129.33)  then  inp(8)  =  129.33 
inp(8)  =  2  *  (inp(8)  -  60.32)  /  69.01  -1 

if(inp(9)<  78.24)  then  inp(9)=  78.24 
if(inp(9)>  198.23)  then  inp(9)=  198.23 
inp(9)  =  2  *  (inp(9)  -  78.24)  / 1 19.99  -1 

if(inp(10)<  277596.7)  then  inp(10)=  27'  >6.7 
if(inp(10)>  713482.1)  then  inp(10)=  713^82.1 
inp(10)  =  2  *  (inp(10)  -  277596.7)  /  435885.4  -1 

if  (inp(l  1)<  206.14)  then  inp(l  1)  =  206.14 
if  (inp(l  1)>  253.96)  then  inp(l  1)  =  253.96 
inp(ll)=  2*(inp(ll)-  206.14)  /  47.82001 -1 

if  (inp(12)<  330.48)  then  inp(12)  =  330.48 
finp(12)>  503.75)  then  inp(12)  =  503.75 
inp(12)=  2*(inp(12)-  330.48)/ 173.27 -1 

if  (inp(13)<  1965.73)  then  inp(13)  =  1965.73 
if  (inp(13)>  3686.02)  then  inp(13)  =  3686.02 
inp(13)=  2*(inp(13)-  1965.73)  / 1720.29 -1 

if  (inp(14)<  78.24)  then  inp(14)  =  78.24 
if(inp(14)>  198.23)  then  inp(14)=  198.23 
inp(14)  =2*  (inp(14)  -  78.24)  / 1 19.99  -1 

netsum  =  -.6301715 
netsum  =  netsum  +  inp(  1 )  *  .40 1 5678 
netsum  =  netsum  +  inp(2)  *  .1923304 
netsum  =  netsum  +  inp(3)  *  .3034808 
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netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10) 
netsum  =  netsum  +  inp(l  1)  * 


netsum  =  netsum  +  inp(12)  *  -.1067936 
netsum  =  netsum  +  inp(13)  *  .192736 
netsum  =  netsum  +  inp(14)  *  .2648861 
feature2(l)  =  exp(-netsum  *  netsum) 


.471424 
-.522025 
-.3444886 

.2156871 
-.0962563 

8.8101 11E-02 
*  .8480121 
1.090916E-02 


-.1590329 

-6.405292E-02 

.1000905 

-.2733166 

.2708781 


netsum  =  7.7841 5  5E-02 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  *  -.2224024 
netsum  =  netsum  +  inp(7)  *  -.6161205 
netsum  =  netsum  +  inp(8)  *  .1161 777 
netsum  =  netsum  +  inp(9)  *  9.140761E-02 
netsum  =  netsum  +  inp(10)  *  .6487405 
netsum  =  netsum  +  inp(l  1)  *  -6.036293E-02 
netsum  =  netsum  +  inp(12)  *  3.895962E-02 
netsum  =  netsum  +  inp(13)  *  -.1787288 
netsum  =  netsum  +  inp(14)  *  .333038 
feature2(2)  =  exp(-netsum  *  netsum) 


.2471741 
.3450775 


netsum  =  -.2859306 

netsum  =  netsum  +  inp(l)  * 

netsum  =  netsum  +  inp(2)  * 

netsum  =  netsum  +  inp(3)  *  8.9621 5 1E-02 

netsum  =  netsum  +  inp(4)  *  4.607785E-02 

netsum  =  netsum  +  inp(5)  *  -6.669939E-02 

netsum  =  netsum  +  inp(6)  *  -.1497742 

netsum  =  netsum  +  inp(7)  *  .3083329 

netsum  =  netsum  +  inp(8)  *  8.747423E-02 

netsum  =  netsum  +  inp(9)  *  -1 .843768E-02 

netsum  =  netsum  +  inp(10)  *  .2710629 

netsum  =  netsum  +  inp(l  1)  * 

netsum  =  netsum  +  inp(12)  * 

netsum  =  netsum  +  inp(13)  * 

netsum  =  netsum  +  inp(14)  * 


.3533338 
-.1935388 
.1157563 
-.3057612 


feature2(3)  =  exp(-netsum  *  netsum) 
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7.340278E-02 

1.156442E-02 

-.1988501 

.1112011 

4.713702E-03 

-.1553141 


netsum=  .3307071 

netsum  =  netsum  +  inp(l)  * 

netsum  =  netsum  +  inp(2)  * 

netsum  =  netsum  +  inp(3)  * 

netsum  =  netsum  +  inp(4)  * 

netsum  =  netsum  +  inp(5)  * 

netsum  =  netsum  +  inp(6)  * 

netsum  =  netsum  +  inp(7)  *  -.148536 

netsum  =  netsum  +  inp(8)  *  .2287395 

netsum  =  netsum  +  inp(9)  *  .  1 9970 1 3 

netsum  ■  netsum  +  inp(10)  *  -.4850825 

netsum  =  netsur  +  inp(l  1)  * 

netsum  =  netsur:.  +  inp(12)  * 

netsum  =  netsum  +  inp(13)  * 

netsum  =  netsum  +  inp(14)  * 


.7133386 
.3967151 
.6160113 
3.598906E-03 


feature2(4)  =  exp(-netsum  *  netsum) 


-5.007538E-03 
-.237791 
8.6801 19E-02 
.229306 
-.1694554 
.1752781 


netsum  =  1.679392E-02 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  *  -.1325122 
netsum  =  netsum  +  inp(8)  *  -3.663547E-02 
netsum  =  netsum  +  inp(9)  *  -.1 170656 
netsum  =  netsum  +  inp(10)  *  -.2149827 
netsum  =  netsum  +  inp(  11)*  .22 1 7486 
netsum  =  netsum  +  inp(  1 2)  *  .1 699766 
netsum  =  netsum  +  inp(13)  *  -7.920565E-02 
netsum  =  netsum  +  inp(  14)*.  1 580922 
feature2(5)  =  exp(-netsum  *  netsum) 


netsum  =  4.819342E-02 
netsum  =  netsum  +  inp(l)  *  - 
netsum  =  netsum  +  inp(2)  *  - 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  *  - 
netsum  -  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  *  - 
netsum  =  netsum  +  inp(  1 0)  * 


5.559232E-02 
.2133055 
.0223891 
.1393356 
.3481391 
.3444548 
.1126457 
.2515414 
.2600302 
.1857713 


84 


netsum  =  netsum  +  inp(l  1)  *  .1466804 
netsum  =  netsum  +  inp(12)  *  8.555 102E-02 
netsum  =  netsum  +  inp(13)  *  -6.2601 7 1E-02 
netsum  =  netsum  +  inp(14)  *  -.1 186699 
feature2(6)  =  exp(-netsum  *  netsum) 


netsum  =  1 .07775 1E-03 

netsum  =  netsum  +  inp(l)  * 

netsum  =  netsum  +  inp(2)  * 

netsum  =  netsum  +  inp(3)  * 

netsum  =  netsum  +  inp(4)  * 

netsum  =  netsum  +  inp(5)  * 

netsum  =  netsum  +  inp(6)  * 

netsum  =  netsum  +  inp(7)  * 

netsum  =  netsum  +  inp(8)  *  5.465092E-02 

netsum  =  netsum  +  inp(9)  *  -.1758856 


netsum  =  netsum  +  inp(10)  * 
netsum  =  netsum  +  inp(l  1)  * 
netsum  =  netsum  +  inp(12)  * 
netsum  =  netsum  +  inp(13)  * 
netsum  =  netsum  +  inp(14)  * 


-.31528 

-.3444317 

-.1208438 

.450067 

.0752024 

8.618691E-02 

.1862327 


.1402889 
-5.002017E-02 
-8.8303 19E-02 

4.461 126E-02 
-.1783304 


feature2(7)  =  exp(-netsum  *  netsum) 

netsum  =  .2010598 
netsum  =  netsum  +  inp(l)  *  -.2251 198 
netsum  =  netsum  +  inp(2)  *  -5.359336E-02 
netsum  =  netsum  +  inp(3)  *  -.2414816 
netsum  =  netsum  +  inp(4)  *  .25571 69 
netsum  =  netsum  +  inp(5)  *  .31 8735 1 
netsum  =  netsum  +  inp(6)  *  -.2540528 
netsum  =  netsum  +  inp(7)  *  .1812858 
netsum  =  netsum  +  inp(8)  *  -.2384627 
netsum  =  netsum  +  inp(9)  *  -.0457608 
netsum  =  netsum  +  inp(10)  *  -.2491588 
netsum  =  netsum  +  inp(l  1)  *  -5.90673 1E-02 
netsum  =  netsum  +  inp(12)  *  -.2001718 
netsum  =  netsum  +  inp(13)  *  .120379 
netsum  =  netsum  +  inp(14)  *  .  1 1 83008 
feature2(8)  =  exp(-netsum  *  netsum) 

netsum  =  .112657 

netsum  =  netsum  +  inp(l)  *  -.1262439 
netsum  =  netsum  +  inp(2)  *  -5.584 108E-02 
netsum  =  netsum  +  inp(3)  *  5.810664E-02 
netsum  =  netsum  +  inp(4)  *  4.7428 16E-02 
netsum  =  netsum  +  inp(5)  *  .  1 374272 
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netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 


netsum  + 
netsum  + 
netsum  + 
netsum  + 
netsum  + 
netsum  + 
netsum  + 
netsum  + 
netsum  + 


inp(6)  * 
inp(7)  * 
inp(8)  * 
inp(9)  * 
inp(10)* 
inp(ll)* 
inp(12)  * 
inp(13)* 
inp(14)  * 


1569632 
1107642 
1762077 
228175 
7.341 71 7E-02 
-.3403822 
.2044954 
9.120224E-02 
-.303437 


feature2(9)  =  exp(-netsum  *  netsum) 


netsum  =  -.1239542 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  *  - 
netsum  =  netsum  +  inp(4)  *  - 
netsum  =  netsum  +  inp(5)  *  - 
netsum  =  netsum  +  inp(6)  *  - 
netsum  =  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  *  - 
netsum  =  netsum  +  inp(10)  * 
netsum  =  netsum  +  inp(l  1)  * 
netsum  =  netsum  +  inp(12)  * 
netsum  =  netsum  +  inp(13)  * 
netsum  =  netsum  +  inp(14)  * 
feature3(l)  =  tanh(netsum) 


6.883536E-02 

.1504488 

•.1053862 

■.1535371 

•.2344521 

.204491 

8.043891E-02 

7.4463 15E-02 

3.834013E-02 

.2165757 
-.1488486 

5.801 564E-02 

.2320869 

.2076355 


netsum  =  .3126868 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10) 
netsum  =  netsum  +  inp(l  1) 
netsum  =  netsum  +  inp(  1 2) 
netsum  =  netsum  +  inp(13) 
netsum  =  netsum  +  inp(  1 4) 
feature3(2)  =  tanh(netsum) 

netsum  =  4.668346E-02 


.1616008 

3.386919E-02 
-.1983408 
-.3485649 
-.1106689 
-.1445011 

.3310095 
-.2066913 
-.2082781 

*  5.758699E-02 
* -6.4271 13E-02 

*  2.970282E-02 

*  -.2802488 

*  .252078 
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netsum  =  netsum  +  inp(l)  *  • 
netsum  =  netsum  +  inp(2)  *  ■ 
netsum  -  netsum  +  inp(3)  *  ■ 
netsum  =  netsum  +  inp(4)  *  - 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  *  - 
netsum  =  netsum  +  inp(7)  *  - 
netsum  =  netsum  +  inp(8)  *  ■ 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10)  * 
netsum  =  netsum  +  inp(l  1)  * 
netsum  =  netsum  +  inp(12)  * 
netsum  =  netsum  +  inp(13)  * 
netsum  =  netsum  +  inp(14)  * 
feature3(3)  =  tanh(netsum) 

netsum  =  3.868202E-02 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  *  - 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10)  * 
netsum  =  netsum  +  inp(l  1)  * 
netsum  =  netsum  +  inp(12)  * 
netsum  =  netsum  +  inp(13)  * 
netsum  =  netsum  +  inp(14)  * 
feature3(4)  =  tanh(netsum) 


.1714819 

■6.2095  89E-02 

•.1907481 

.1376314 

.2418897 

.2630582 

.2526979 

.1087746 

7.395954E-02 

.1435177 

.1491603 

.1827831 

.3284236 

.1364697 


.402357 

.2806031 

.2690603 

6.963006E-02 

.1762392 

.1347711 

.3312288 

.4110459 

.182495 

7.211982E-02 

7.5748 15E-02 

.3440028 

.4007721 
-.2247503 


netsum  =  1.236538E-02 
netsum  -  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10) 
netsum  =  netsum  +  inp(l  1) 
netsum  =  netsum  +  inp(12) 


1.840403E-02 
-.2597425 

.2060692 

.1866937 

8.07031 1E-03 

6.152835E-02 
-.183747 
-.301769 
-3.505382E-02 

*  -4.599997E-02 

*  2.352656E-02 
* -.1942575 
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netsum  =  netsum  +  inp(13)  * 
netsum  =  netsum  +  inp(14)  * 
feature3(5)  =  tanh(netsum) 


-.1482109 
■8.374985E-02 


netsum  =  -.2077845 
netsum  =  netsum  +  inp(l)  *  - 
netsum  =  netsum  +  inp(2)  *  ■ 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  *  - 
netsum  =  netsum  +  inp(6)  *  - 
netsum  =  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10)  * 
netsum  =  netsum  +  inp(l  1)  * 
netsum  =  netsum  +  inp(12)  * 
netsum  =  netsum  +  inp(13)  * 
netsum  =  netsum  +  inp(14)  * 
feature3(6)  =  tanh(netsum) 


-.3183326 

-.2343775 

2.819597E-02 

.1284694 

-.2394804 

■4.67339E-03 

.6174434 

.4019511 

5.051733E-02 

-.3909052 
7  491957E-02 
5.784418E-02 

-.0298114 

-.1702783 


1.982817E-02 

.1559182 

.0207838 

.2390079 

8.514214E-02 


netsum  =  .1813595 

netsum  =  netsum  +  inp(l)  * 

netsum  =  netsum  +  inp(2)  * 

netsum  =  netsum  +  inp(3)  * 

netsum  =  netsum  +  inp(4)  * 

netsum  =  netsum  +  inp(5)  * 

netsum  =  netsum  +  inp(6)  *  -.2670723 

netsum  =  netsum  +  inp(7)  *  1 .1 09988E-02 

netsum  =  netsum  +  inp(8)  *  -7.6780 13E-02 

netsum  =  netsum  +  inp(9)  *  9.093736E-02 

netsum  =  netsum  +  inp(10)  *  .1590883 

netsum  =  netsum  +  inp(l  1)  * 

netsum  =  netsum  +  inp(12)  * 

netsum  =  netsum  +  inp(13)  * 

netsum  =  netsum  +  inp(14)  * 

feature3(7)  =  tanh(netsum) 


.1004014 
.2035837 
6.611361E-02 
.1934318 


netsum  =  .2397276 
netsum  =  netsum  +  inp(l)  *  -.1992782 
netsum  =  netsum  +  inp(2)  *  -.128719 
netsum  =  netsum  +  inp(3)  *  .  1 892586 
netsum  =  netsum  +  inp(4)  *  9.737 152E-02 
netsum  =  netsum  +  inp(5)  *  -.1388893 
netsum  =  netsum  +  inp(6)  *  8.41 437 1E-02 
netsum  =  netsum  +  inp(7)  *  .4454928 
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netsum  =  netsum  +  inp(8)  *  -.2841288 
netsum  =  netsum  +  inp(9)  *  5.766987E-02 
netsum  =  netsum  +  inp(10)  *  5.085299E-02 
netsum  =  netsum  +  inp(l  1)  *  -.2496866 
netsum  =  netsum  +  inp(12)  *  .3022949 
netsum  =  netsum  +  inp(13)  *  -.3 1 1 1849 
netsum  =  netsum  +  inp(l 4)  *  .1354086 
feature3(8)  =  tanh(netsum) 


netsum  =  -5.716069E-02 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  *  - 
netsum  =  netsum  +  inp(4)  *  - 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  *  - 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10)  * 
netsum  =  netsum  +  inp(l  1)  * 
netsum  =  netsum  +  inp(12)  * 
netsum  =  netsum  +  inp(13)  * 
netsum  =  netsum  +  inp(14)  * 
feature3(9)  =  tanh(netsum) 


.1918543 
.2528775 
.1584775 
.2948896 
.1197234 
.3107863 
.217381 
.1799645 
.2089709 
.2344017 
.142157 
.0758443 
-.2458397 
.1971597 


netsum  =  .2587757 

netsum  =  netsum  +  inp(l)  *  6.33491 1E-02 

netsum  =  netsum  +  inp(2)  *  -.1395912 

netsum  =  netsum  +  inp(3)  *  .2 1 3 8 1 92 

netsum  =  netsum  +  inp(4)  *  - 

netsum  =  netsum  +  inp(5)  *  - 

netsum  =  netsum  +  inp(6)  *  - 

netsum  =  netsum  +  inp(7)  * 

netsum  =  netsum  +  inp(8)  *  - 

netsum  =  netsum  +  inp(9)  * 

netsum  =  netsum  +  inp(10)  * 

netsum  =  netsum  +  inp(l  1)  * 

netsum  =  netsum  +  inp(12)  * 

netsum  =  netsum  +  inp(13)  * 

netsum  =  netsum  +  inp(14)  * 


.1274552 
,1393314 
,2645777 
2876672 

1303833 
2642182 

3.4671 15E-02 

.1072136 
-.1934204 
-.1403725 
-.1843849 


feature4(l)  =  1  -  exp(-netsum  *  netsum) 


netsum  =  .2993304 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 


■8.428704E-03 
,1071872 
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netsum  =  netsum  +  inp(3)  *  -8.796584E-02 
netsum  =  netsum  +  inp(4)  *  .  1 266784 
netsum  =  netsum  +  inp(5)  *  .2506436 
netsum  =  netsum  +  inp(6)  *  4.853629E-02 
netsum  =  netsum  +  inp(7)  *  -.4751402 
netsum  =  netsum  +  inp(8)  *  -.136122 
netsum  =  netsum  +  inp(9)  *  -.3058958 
netsum  =  netsum  +  inp(10)  *  -5.20961 1E-02 
netsum  =  netsum  +  inp(l  1)  *  .3099503 
netsum  =  netsum  +  inp(12)  *  -.1840532 
netsum  =  netsum  +  inp(13)  *  .3218807 
netsum  =  netsum  +  inp(14)  *  .1453303 
feature4(2)  =  1  -  exp(-netsum  *  netsum) 


.3332409 

.2873065 

1.045562E-03 

.2716179 

3.613625E-02 


netsum  =  .1933935 

netsum  =  netsum  +  inp(l)  * 

netsum  =  netsum  +  inp(2)  * 

netsum  =  netsum  +  inp(3)  * 

netsum  =  netsum  +  inp(4)  * 

netsum  =  netsum  +  inp(5)  * 

netsum  =  netsum  +  inp(6)  *  -.3512647 

netsum  =  netsum  +  inp(7)  *  -.301256 

netsum  =  netsum  +  inp(8)  *  -6.802244E-02 

netsum  =  netsum  +  inp(9)  *  5.407644E-02 

netsum  =  netsum  +  inp(10)  *  7.879863E-03 

netsum  =  netsum  +  inp(l  1)  * 

netsum  =  netsum  +  inp(12)  * 

netsum  =  netsum  +  inp(13)  * 

netsum  =  netsum  +  inp(14)  * 

feature4(3)  =  1  -  exp(-netsum 


5.932507E-02 
3.043652E-02 
.1559501 
.1701026 
*  netsum) 


netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 


.1759639 

netsum  +  inp(l)  *  - 
netsum  +  inp(2)  *  - 
netsum  +  inp(3)  *  - 
netsum  +  inp(4)  *  - 
netsum  +  inp(5)  *  - 
netsum  +  inp(6)  *  - 
netsum  +  inp(7)  * 
netsum  +  inp(8)  *  - 
netsum  +  inp(9)  *  - 
netsum  +  inp(10)  * 
netsum  +  inp(ll)  * 
netsum  +  inp(12)  * 
netsum  +  inp(13)  * 
netsum  +  inp(14)  * 


.6680542 

.2973823 

.3279465 

.1164177 

.6758547 

5.386759E-02 

.4030443 

.337681 

.2303785 

-.4204697 

.2685212 

.3571743 
-.3708806 
-.4410872 
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feature4(4)  =  1  -  exp(-netsum  *  netsum) 

netsum  =  -7.085525E-02 
netsum  =  netsum  +  inp(l)  *  .2006301 
netsum  =  netsum  +  inp(2)  *  9.63398 1E-02 
netsum  =  netsum  +  inp(3)  *  -.0126803 
netsum  =  netsum  +  inp(4)  *  .  1 2265 1 9 
netsum  =  netsum  +  inp(5)  *  -8.257607E-02 
netsum  =  netsum  +  inp(6)  *  -.2301209 
netsum  =  netsum  +  inp(7)  *  .1052367 
netsum  =  netsum  +  inp(8)  *  .230889 
netsum  =  netsum  +  inp(9)  *  -.1533706 
netsum  =  netsum  +  inp(10)  *  -.1561237 
netsum  =  netsum  +  inp(l  1)  *  8.230709E-02 
netsum  =  netsum  +  inp(12)  *  -.3135089 
netsum  =  netsum  +  inp(13)  *  -.2566093 
netsum  =  netsum  +  inp(14)  *  .3265928 
feature4(5)  =  1  -  exp(-netsum  *  netsum) 


netsum  =  .2666591 
netsum  =  netsum  +  inp(l)  *  -.163848 
netsum  =  netsum  +  inp(2)  *  -.633084 
netsum  =  netsum  +  inp(3)  *  -.1689773 
netsum  =  netsum  -r  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 
netsum  =  netsum  +  inp(10) 


.5006466 
.419012 
4.7455 18E-02 
■.2422797 
.4093167 
•5.734261E-02 
-.3980823 


netsum  =  netsum  +  inp(l 1) *   1 .593639E-02 
netsum  =  netsum  +  inp(12)  *  -.2957138 
netsum  =  netsum  +  inp(13)  *  -7.563066E-03 
netsum  =  netsum  +  inp(14)  *  -8.185922E-03 
feature4(6)  =  1  -  exp(-netsum  *  netsum) 


netsum  =  -.1909794 
netsum  =  netsum  +  inp(l)  * 
netsum  =  netsum  +  inp(2)  * 
netsum  =  netsum  +  inp(3)  * 
netsum  =  netsum  +  inp(4)  * 
netsum  =  netsum  +  inp(5)  * 
netsum  =  netsum  +  inp(6)  * 
netsum  =  netsum  +  inp(7)  * 
netsum  =  netsum  +  inp(8)  * 
netsum  =  netsum  +  inp(9)  * 


-.1831633 
-4.4500 19E-02 
-.1683403 
-.1905011 

.1881501 

.4262969 
-.2553455 

.1917894 

.3827554 
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netsum  =  netsum  +  inp(10)  *  -3.7228 18E-02 
netsum  =  netsum  +  inp(l  1)  *  .4479087 
netsum  =  netsum  +  inp(12)  *  2.176078E-02 
netsum  =  netsum  +  inp(13)  *  -.295205 
netsum  =  netsum  +  inp(14)  *  .1430879 
feature4(7)  =  1  -  exp(-netsum  *  netsum) 

netsum  =  -.2656472 
netsum  =  netsum  +  inp(l)  *  -.2388305 
netsum  =  netsum  +  inp(2)  *  -7.188458E-02 
netsum  =  netsum  +  inp(3)  *  -.297852 
netsum  =  netsum  +  inp(4)  *  .  1 50673 1 
netsum  =  netsum  +  inp(5)  *  .2484149 
netsum  =  netsum  +  inp(6)  *  5.983697E-02 
netsum  =  netsum  +  inp(7)  *  -.1939304 
netsum  =  netsum  +  inp(8)  *  6.954922E-02 
netsum  =  netsum  +  inp(9)  *  -.2615168 
netsum  =  netsum  +  inp(10)  *  -.2277467 
netsum  =  netsum  +  inp(l  1)  *  -.1542342 
netsum  =  netsum  +  inp(12)  *  -6.928023E-02 
netsum  =  netsum  +  inp(13)  *  -.2817874 
netsum  =  netsum  +  inp(14)  *  .207139 
feature4(8)  =  1  -  exp(-netsum  *  netsum) 


6.293206E-03 

1.832035E-03 

.1134438 

1.824013E-02 

5.927859E-02 

.1220353 

7.248743E-02 

.1827504 

2.891 132E-02 


netsum  =  .1556563 

netsum  =  netsum  +  inp(l)  * 

netsum  =  netsum  +  inp(2)  * 

netsum  =  netsum  +  inp(3)  * 

netsum  =  netsum  +  inp(4)  * 

netsum  =  netsum  +  inp(5)  * 

netsum  =  netsum  +  inp(6)  * 

netsum  =  netsum  +  inp(7)  * 

netsum  =  netsum  +  inp(8)  * 

netsum  =  netsum  +  inp(9)  * 

netsum  =  netsum  +  inp(10)  *  -.1420365 

netsum  =  netsum  +  inp(l  1)  *  .2402575 

netsum  =  netsum  +  inp(12)  *  -.2662137 

netsum  =  netsum  +  inp(13)  *  -.2764541 

netsum  =  netsum  +  inp(14)  *  .1470288 

feature4(9)  =  1  -  exp(-netsum  *  netsum) 

netsum  =  -.2403532 

netsum  =  netsum  +  feature2(l)  *  .8336458 
netsum  =  netsum  +  feature2(2)  *  .7772395 
netsum  =  netsum  +  feature2(3)  *  -.3676423 
netsum  =  netsum  +  feature2(4)  *  -.856063 1 
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netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
outp(l) 


netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
netsum 
1/(1  + 


+  feature2(5 
+  feature2(6 
+  feature2(7 
+  feature2(8 
+  feature2(9 
+  2.389552E 
+  feature3(l 
+  feature3(2 
+  feature3(3 
+  feature3(4 
+  feature3(5 
+  feature3(6 
+  feature3(7 
+  feature3(8 
+  feature3(9 
+  -.0645455 
+  feature4(l 
+  feature4(2 
+  feature4(3 
+  feature4(4 
+  feature4(5 
+  feature4(6 
+  feature4(7 
+  feature4(8 
+  feature4(9 
exp(-netsum 


*  -3.738723E-03 
* -.2726331 

*  .4049881 

*  -9.708894E-02 

*  -.3385944 
-02 

* -.2318477 
*-9.119899E-02 

*  -.3589992 

*  .4774115 

*  .1890002 
.6112313 
.1102381 
.4290453 
6.637502E-02 


*  -.2677609 

*  -.4827854 

*  .2690243 

*  .9494663 

*  .2479254 

*  -.5345625 

*  .5549127 

*  6.0485 15E-03 

*  .1529618 


) 


outp(l)=  538*  (outp(l)-.l)/.8  +  649 
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